Sep 25 16:55:02 devstack cinder-volume[76001]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 16:55:02 devstack cinder-volume[76001]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:55:02 devstack cinder-volume[76001]: we strongly recommend against using it for new projects. Sep 25 16:55:02 devstack cinder-volume[76001]: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:55:02 devstack cinder-volume[76001]: framework. For more detail see Sep 25 16:55:02 devstack cinder-volume[76001]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:55:02 devstack cinder-volume[76001]: import eventlet # noqa Sep 25 16:55:06 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:55:06 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:55:06 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:55:06 devstack cinder-volume[76001]: INFO dbcounter [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Registered counter for database cinder Sep 25 16:55:06 devstack cinder-volume[76001]: DEBUG oslo_db.sqlalchemy.engines [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:55:07 devstack cinder-volume[76001]: DEBUG dbcounter [-] [76001] Writer thread running {{(pid=76001) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:55:07 devstack cinder-volume[76001]: INFO cinder.rpc [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 16:55:07 devstack cinder-volume[76001]: INFO cinder.rpc [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 16:55:07 devstack cinder-volume[76001]: DEBUG oslo_db.sqlalchemy.engines [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:55:07 devstack cinder-volume[76001]: INFO cinder.volume.manager [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Determined volume DB was empty at startup. Sep 25 16:55:07 devstack cinder-volume[76001]: DEBUG cinder.volume.manager [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76001) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 16:55:07 devstack cinder-volume[76001]: INFO cinder.volume.manager [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 16:55:07 devstack cinder-volume[76001]: WARNING stevedore.named [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:55:07 devstack cinder-volume[76001]: WARNING castellan.key_manager [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:55:07 devstack cinder-volume[76001]: WARNING cinder.keymgr.conf_key_mgr [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:55:07 devstack cinder-volume[76001]: DEBUG cinder.volume.drivers.lvm [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76001) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 16:55:07 devstack cinder-volume[76001]: DEBUG oslo_concurrency.processutils [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76001) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_concurrency.processutils [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] CMD "cinder-rtstool verify" returned: 0 in 0.424s {{(pid=76001) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_db.sqlalchemy.engines [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:55:08 devstack cinder-volume[76001]: INFO cinder.rpc [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 16:55:08 devstack cinder-volume[76001]: INFO cinder.rpc [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 16:55:08 devstack cinder-volume[76001]: WARNING stevedore.named [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:55:08 devstack cinder-volume[76001]: WARNING castellan.key_manager [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:55:08 devstack cinder-volume[76001]: INFO cinder.volume.manager [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_db.sqlalchemy.engines [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:55:08 devstack cinder-volume[76001]: INFO oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Starting 1 workers Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Started child 76125 {{(pid=76001) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Full set of CONF: {{(pid=76001) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] ******************************************************************************** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Configuration options gathered from: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] ================================================================================ {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] allow_availability_zone_fallback = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] allow_compression_on_image_upload = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] allowed_direct_url_schemes = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] api_rate_limit = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] auth_strategy = keystone {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] az_cache_duration = 3600 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_availability_zone = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_host = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_stats_polling_interval = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backup_api_class = cinder.backup.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backup_name_template = backup-%s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backup_use_same_host = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76125]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backup_use_temp_snapshot = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] chap_password = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] chap_username = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cinder_internal_tenant_project_id = eaea8f6f3899424189f96c0f9b204f0e {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cinder_internal_tenant_user_id = 9d8088ff0fda48ea9cf4b7125381f928 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cloned_volume_same_az = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cluster = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] compression_format = gzip {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] compute_api_class = cinder.compute.nova.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] config_dir = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] config_source = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] control_exchange = openstack {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] debug = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] default_availability_zone = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] default_group_type = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] default_volume_type = lvmdriver-1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] disk_geometry = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] driver_client_cert = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] driver_client_cert_key = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] driver_data_namespace = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] driver_ssl_cert_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] driver_ssl_cert_verify = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] driver_use_ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] enable_force_upload = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] enable_new_services = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] enable_unsupported_driver = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] enforce_multipath_for_image_xfer = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] filter_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_api_insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_api_servers = ['http://192.168.122.90/image'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_api_ssl_compression = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_ca_certificates_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_catalog_info = image:glance:publicURL {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_num_retries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance_request_timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] goodness_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] graceful_shutdown_timeout = 5 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] group_api_class = cinder.group.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] host = devstack {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_compress_on_upload = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_conversion_address_space_limit = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_conversion_cpu_limit = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_conversion_disable = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_introspection_address_space_limit = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_introspection_cpu_limit = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_upload_use_cinder_backend = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_upload_use_internal_tenant = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_volume_cache_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_volume_cache_max_count = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] image_volume_cache_max_size_gb = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] init_host_max_objects_retrieval = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] instance_format = [instance: %(uuid)s] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] iscsi_target_flags = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] iscsi_write_cache = on {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] iser_helper = tgtadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] iser_ip_address = 192.168.122.90 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] iser_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] log_color = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] log_config_append = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] log_dir = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] log_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] log_options = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] log_rotate_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] log_rotate_interval_type = days {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] log_rotation_type = none {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] max_age = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] max_logfile_count = 30 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] max_logfile_size_mb = 200 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] max_over_subscription_ratio = 20.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] message_reap_interval = 86400 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] message_ttl = 2592000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] migration_create_volume_timeout_secs = 300 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] monkey_patch = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] monkey_patch_modules = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] my_ip = 192.168.122.90 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] no_snapshot_gb_quota = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] num_iser_scan_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] num_shell_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] num_volume_device_scan_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] nvmeof_conn_info_version = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] nvmet_ns_id = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] nvmet_port_id = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] osapi_max_limit = 1000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] osapi_volume_ext_list = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] osapi_volume_listen_port = 8776 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] osapi_volume_use_ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] osapi_volume_workers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] per_volume_size_limit = -1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] periodic_fuzzy_delay = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] periodic_interval = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] public_endpoint = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] publish_errors = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] quota_backup_gigabytes = 1000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] quota_backups = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] quota_gigabytes = 1000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] quota_groups = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] quota_snapshots = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] quota_volumes = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] rate_limit_burst = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] rate_limit_except_level = CRITICAL {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] rate_limit_interval = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] reinit_driver_count = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] replication_device = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] report_discard_supported = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] report_interval = 120 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76125]: INFO cinder.volume.manager [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] reservation_clean_interval = 86400 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] reservation_expire = 86400 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] reserved_image_namespaces = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] reserved_percentage = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] rpc_response_timeout = 120 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] run_external_periodic_tasks = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] scst_target_driver = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] scst_target_iqn_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_down_time = 720 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] shell_completion = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] snapshot_name_template = snapshot-%s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] snapshot_same_host = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] state_path = /opt/stack/data/cinder {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] storage_availability_zone = nova {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] storage_protocol = iSCSI {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] syslog_log_facility = LOG_USER {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] target_helper = lioadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] target_ip_address = 192.168.122.90 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] target_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] target_protocol = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] target_secondary_ip_addresses = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] trace_flags = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] transport_url = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] until_refresh = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] use_chap_auth = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] use_default_quota_class = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] use_journal = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] use_json = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] use_multipath_for_image_xfer = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] use_stderr = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] use_syslog = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] verify_glance_signatures = enabled {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_api_class = cinder.volume.api.API {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_backend_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_clear = zero {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_clear_ionice = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_clear_size = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_copy_bps_limit = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_dd_blocksize = 1M {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_name_template = volume-%s {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_service_inithost_offload = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volume_usage_audit_period = month {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] zoning_mode = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_concurrency.disable_process_locking = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.auth_section = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.auth_type = password {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.auth_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.cache = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.include_service_catalog = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.interface = public {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_password = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcache_username = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.region_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.service_type = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.90/identity {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.backend = dogpile.cache.null {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.backend_argument = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.backend_expiration_time = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.config_prefix = cache.oslo {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.debug_cache_backend = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.enable_retry_client = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.enable_socket_keepalive = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.expiration_time = 600 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.hashclient_retry_attempts = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.memcache_dead_retry = 300 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.memcache_pool_maxsize = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.memcache_sasl_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.password = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.proxies = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.redis_db = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.redis_server = localhost:6379 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.retry_attempts = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.retry_delay = 0.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.socket_keepalive_count = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.socket_keepalive_idle = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.socket_keepalive_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.socket_timeout = 1.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.tls_allowed_ciphers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.tls_cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.tls_certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.tls_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.tls_keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cache.username = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] coordination.backend_url = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.asyncio_connection = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.asyncio_slave_connection = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.backend = sqlalchemy {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.connection = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.connection_debug = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.connection_parameters = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.connection_recycle_time = 3600 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.connection_trace = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.db_inc_retry_interval = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.db_max_retries = 20 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.db_max_retry_interval = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.db_retry_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.max_overflow = 50 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.max_pool_size = 5 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.max_retries = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.mysql_wsrep_sync_wait = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.pool_timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.retry_interval = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.slave_connection = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.sqlite_synchronous = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.synchronous_reader = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] database.use_db_reconnect = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_tracing.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.connection_string = messaging:// {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.es_doc_type = notification {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.es_scroll_size = 10000 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.es_scroll_time = 2m {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.filter_error_trace = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.hmac_keys = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.sentinel_service_name = mymaster {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.socket_timeout = 0.1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.trace_requests = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler.trace_sqlalchemy = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler_jaeger.process_tags = {} {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler_jaeger.service_name_prefix = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] profiler_otlp.service_name_prefix = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.enforce_new_defaults = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.policy_default_rule = default {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.policy_file = policy.yaml {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack sudo[76129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack sudo[76129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] privsep_osbrick.group = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] privsep_osbrick.helper_command = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] privsep_osbrick.user = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cinder_sys_admin.group = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cinder_sys_admin.helper_command = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] cinder_sys_admin.user = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.auth_section = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.auth_type = password {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.collect_timing = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.send_service_user_token = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.tls_ciphers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] service_user.tls_min_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.auth_section = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.auth_type = password {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.collect_timing = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.region_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.tls_ciphers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] glance.tls_min_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.backend_availability_zone = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.chap_password = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.chap_username = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.disk_geometry = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.driver_client_cert = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.driver_client_cert_key = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.driver_data_namespace = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.driver_use_ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.extra_capabilities = {} {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.filter_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.goodness_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.iscsi_target_flags = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.iscsi_write_cache = on {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.iser_helper = tgtadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.iser_ip_address = 192.168.122.90 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.iser_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.lvm_share_target = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.lvm_type = auto {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.num_shell_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.replication_device = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.report_discard_supported = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.reserved_percentage = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.target_helper = tgtadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.target_ip_address = 192.168.122.90 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.target_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.target_protocol = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.trace_flags = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.unique_fqdn_network = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.use_chap_auth = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volume_backend_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volume_clear = zero {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volume_clear_ionice = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volume_clear_size = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_reports.file_event_handler = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_reports.log_dir = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.backend_host = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.chap_password = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.chap_username = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.disk_geometry = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.driver_client_cert = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.extra_capabilities = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.filter_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.goodness_function = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.iser_helper = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.iser_ip_address = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.iser_port = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.lvm_share_target = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.lvm_type = auto {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.num_shell_tries = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.replication_device = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.report_discard_supported = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.reserved_percentage = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.scst_target_driver = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.storage_protocol = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.target_helper = lioadm {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.target_ip_address = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.target_port = 3260 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.trace_flags = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.use_chap_auth = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volume_clear = zero {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volume_clear_size = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] lvmdriver-1.volumes_dir = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_notifications.driver = [] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_notifications.retry = -1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] key_manager.fixed_key = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.barbican_api_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.barbican_endpoint = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.barbican_endpoint_type = public {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.barbican_region_name = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.collect_timing = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.number_of_retries = 60 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.retry_delay = 1 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.send_service_user_token = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.tls_ciphers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.tls_min_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.verify_ssl = True {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican.verify_ssl_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.auth_section = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.auth_type = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.cafile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.certfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.collect_timing = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.insecure = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.keyfile = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.split_loggers = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.timeout = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.tls_ciphers = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] barbican_service_user.tls_min_version = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.approle_role_id = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.approle_secret_id = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.auth_method = approle {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.auth_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.kv_mountpoint = secret {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.kv_path = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.kv_version = 2 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.namespace = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.root_token_id = **** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.ssl_ca_crt_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.timeout = 60.0 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.token_file = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.token_role = None {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.use_ssl = False {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:55:08 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] ******************************************************************************** {{(pid=76001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 16:55:08 devstack sudo[76129]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:08 devstack sudo[76258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:55:08 devstack sudo[76258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:08 devstack sudo[76258]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.281s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 16:55:08 devstack cinder-volume[76125]: INFO cinder.brick.local_dev.lvm [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 16:55:08 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:09 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:09 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:09 devstack sudo[76348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:55:09 devstack sudo[76348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:09 devstack sudo[76348]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:09 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:09 devstack cinder-volume[76125]: DEBUG cinder.brick.local_dev.lvm [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76125) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 16:55:09 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:09 devstack sudo[76432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:55:09 devstack sudo[76432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:09 devstack sudo[76432]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:09 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.603s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:09 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:09 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:09 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:09 devstack sudo[76623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:55:09 devstack sudo[76623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:10 devstack sudo[76623]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:10 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.395s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:10 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:10 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:10 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:10 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 16:55:10 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:10 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:10 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.301s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:10 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:10 devstack sudo[76819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:55:10 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:11 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.381s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:11 devstack sudo[76903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:55:11 devstack sudo[76903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:11 devstack sudo[76903]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:11 devstack sudo[76912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:55:11 devstack sudo[76912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:11 devstack sudo[76912]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:11 devstack sudo[77001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:55:11 devstack sudo[77001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:11 devstack sudo[77001]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:11 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:11 devstack sudo[77005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:55:11 devstack sudo[77005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:12 devstack sudo[77005]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:12 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:12 devstack cinder-volume[76125]: INFO cinder.volume.drivers.lvm [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 16:55:12 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:12 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:12 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:12 devstack sudo[77009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:55:12 devstack sudo[77009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:12 devstack sudo[77009]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:12 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:12 devstack cinder-volume[76125]: DEBUG cinder.volume.drivers.lvm [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Updating volume stats {{(pid=76125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:55:12 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:12 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:55:12 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:12 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:12 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:12 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:12 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:55:12 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:13 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:13 devstack sudo[77018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:55:13 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:13 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:13 devstack sudo[77021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:55:13 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:13 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:13 devstack cinder-volume[76125]: INFO cinder.volume.driver [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Driver hasn't implemented _init_vendor_properties() Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG cinder.volume.driver [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76125) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG oslo_db.sqlalchemy.engines [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76125) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG dbcounter [-] [76125] Writer thread running {{(pid=76125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG cinder.db.api [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Building query based on filter {{(pid=76125) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG cinder.image.image_utils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76125) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 16:55:13 devstack cinder-volume[76125]: INFO cinder.keymgr.migration [None req-6bb5820f-6dd2-44a4-90a5-cdc9c6d78a20 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG cinder.volume.drivers.lvm [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Updating volume stats {{(pid=76125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:55:13 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:13 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:55:13 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:14 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:14 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:14 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:14 devstack sudo[77029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:55:14 devstack sudo[77029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:14 devstack sudo[77029]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:14 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:14 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:14 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:55:14 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:14 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:14 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:14 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:14 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:55:14 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:15 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG cinder.manager [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Notifying Schedulers of capabilities ... {{(pid=76125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:55:15 devstack cinder-volume[76125]: INFO cinder.volume.manager [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Driver initialization completed successfully. Sep 25 16:55:15 devstack cinder-volume[76125]: INFO cinder.manager [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Initiating service 2 cleanup Sep 25 16:55:15 devstack cinder-volume[76125]: INFO cinder.manager [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Service 2 cleanup completed. Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG cinder.service [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Creating RPC server for service cinder-volume {{(pid=76125) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG cinder.service [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76125) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 16:55:15 devstack cinder-volume[76125]: INFO cinder.volume.manager [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG cinder.volume.drivers.lvm [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Updating volume stats {{(pid=76125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:15 devstack sudo[77043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:55:15 devstack sudo[77043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:15 devstack sudo[77043]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:15 devstack sudo[77048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:55:15 devstack sudo[77048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:15 devstack sudo[77048]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:15 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:15 devstack sudo[77051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:55:15 devstack sudo[77051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:16 devstack sudo[77051]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:16 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:16 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:55:16 devstack sudo[77054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:55:16 devstack sudo[77054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:55:16 devstack sudo[77054]: pam_unix(sudo:session): session closed for user root Sep 25 16:55:16 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:55:16 devstack cinder-volume[76125]: INFO cinder.volume.manager [None req-7a75eb51-edab-4e88-bd2c-68fcab90c8bd None None] Driver post RPC initialization completed successfully. Sep 25 16:55:18 devstack cinder-volume[76001]: DEBUG dbcounter [-] [76001] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76001) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:55:26 devstack cinder-volume[76125]: DEBUG dbcounter [-] [76125] Writing DB stats cinder:SELECT=4 {{(pid=76125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:55:26 devstack cinder-volume[76125]: DEBUG dbcounter [-] [76125] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:55:51 devstack cinder-volume[76125]: DEBUG oslo_service.periodic_task [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running periodic task VolumeManager._thread_info {{(pid=76125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:55:51 devstack cinder-volume[76125]: DEBUG cinder.volume.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] thread count: 6 {{(pid=76125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:55:51 devstack cinder-volume[76125]: DEBUG cinder.volume.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] thread info: [<_MainThread(MainThread, started 125897925767296)>, , , , , ] {{(pid=76125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:56:51 devstack cinder-volume[76125]: DEBUG oslo_service.periodic_task [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:56:51 devstack cinder-volume[76125]: DEBUG cinder.volume.drivers.lvm [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Updating volume stats {{(pid=76125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:56:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:56:51 devstack sudo[80100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:56:51 devstack sudo[80100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:56:51 devstack sudo[80100]: pam_unix(sudo:session): session closed for user root Sep 25 16:56:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:56:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:56:51 devstack sudo[80241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:56:51 devstack sudo[80241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:56:51 devstack sudo[80241]: pam_unix(sudo:session): session closed for user root Sep 25 16:56:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:56:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:56:51 devstack sudo[80387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:56:51 devstack sudo[80387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:56:52 devstack sudo[80387]: pam_unix(sudo:session): session closed for user root Sep 25 16:56:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:56:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:56:52 devstack sudo[80566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:56:52 devstack sudo[80566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:56:52 devstack sudo[80566]: pam_unix(sudo:session): session closed for user root Sep 25 16:56:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:56:52 devstack cinder-volume[76125]: DEBUG cinder.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Notifying Schedulers of capabilities ... {{(pid=76125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:56:52 devstack cinder-volume[76125]: DEBUG oslo_service.periodic_task [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running periodic task VolumeManager._thread_info {{(pid=76125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:56:52 devstack cinder-volume[76125]: DEBUG cinder.volume.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] thread count: 6 {{(pid=76125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:56:52 devstack cinder-volume[76125]: DEBUG cinder.volume.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] thread info: [<_MainThread(MainThread, started 125897925767296)>, , , , , ] {{(pid=76125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:57:26 devstack cinder-volume[76125]: DEBUG dbcounter [-] [76125] Writing DB stats cinder:SELECT=1 {{(pid=76125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:57:26 devstack cinder-volume[76125]: DEBUG dbcounter [-] [76125] Writing DB stats cinder:UPDATE=1 {{(pid=76125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:57:51 devstack cinder-volume[76125]: DEBUG oslo_service.periodic_task [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:57:51 devstack cinder-volume[76125]: DEBUG cinder.volume.drivers.lvm [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Updating volume stats {{(pid=76125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:57:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:57:51 devstack sudo[83326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:57:51 devstack sudo[83326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:57:51 devstack sudo[83326]: pam_unix(sudo:session): session closed for user root Sep 25 16:57:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:57:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:57:51 devstack sudo[83329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:57:51 devstack sudo[83329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:57:51 devstack sudo[83329]: pam_unix(sudo:session): session closed for user root Sep 25 16:57:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:57:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:57:51 devstack sudo[83332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:57:51 devstack sudo[83332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:57:52 devstack sudo[83332]: pam_unix(sudo:session): session closed for user root Sep 25 16:57:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:57:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:57:52 devstack sudo[83341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:57:52 devstack sudo[83341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:57:52 devstack sudo[83341]: pam_unix(sudo:session): session closed for user root Sep 25 16:57:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:57:52 devstack cinder-volume[76125]: DEBUG cinder.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Notifying Schedulers of capabilities ... {{(pid=76125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:57:52 devstack cinder-volume[76125]: DEBUG oslo_service.periodic_task [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running periodic task VolumeManager._thread_info {{(pid=76125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:57:52 devstack cinder-volume[76125]: DEBUG cinder.volume.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] thread count: 6 {{(pid=76125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:57:52 devstack cinder-volume[76125]: DEBUG cinder.volume.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] thread info: [<_MainThread(MainThread, started 125897925767296)>, , , , , ] {{(pid=76125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:58:51 devstack cinder-volume[76125]: DEBUG oslo_service.periodic_task [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:58:51 devstack cinder-volume[76125]: DEBUG cinder.volume.drivers.lvm [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Updating volume stats {{(pid=76125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:58:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:51 devstack sudo[84885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:58:51 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:51 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:51 devstack sudo[84890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:58:51 devstack sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:51 devstack sudo[84890]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:51 devstack sudo[84899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:58:51 devstack sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:52 devstack sudo[84899]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:58:52 devstack sudo[84927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:58:52 devstack sudo[84927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:58:52 devstack sudo[84927]: pam_unix(sudo:session): session closed for user root Sep 25 16:58:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:58:52 devstack cinder-volume[76125]: DEBUG cinder.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Notifying Schedulers of capabilities ... {{(pid=76125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:58:52 devstack cinder-volume[76125]: DEBUG oslo_service.periodic_task [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running periodic task VolumeManager._thread_info {{(pid=76125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:58:52 devstack cinder-volume[76125]: DEBUG cinder.volume.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] thread count: 6 {{(pid=76125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 16:58:52 devstack cinder-volume[76125]: DEBUG cinder.volume.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] thread info: [<_MainThread(MainThread, started 125897925767296)>, , , , , ] {{(pid=76125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 16:59:26 devstack cinder-volume[76125]: DEBUG dbcounter [-] [76125] Writing DB stats cinder:SELECT=1 {{(pid=76125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:59:26 devstack cinder-volume[76125]: DEBUG dbcounter [-] [76125] Writing DB stats cinder:UPDATE=1 {{(pid=76125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 16:59:51 devstack cinder-volume[76125]: DEBUG oslo_service.periodic_task [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 16:59:51 devstack cinder-volume[76125]: DEBUG cinder.volume.drivers.lvm [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Updating volume stats {{(pid=76125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 16:59:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:59:51 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 16:59:51 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:59:51 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Sep 25 16:59:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:59:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:59:51 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:59:51 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:59:51 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Sep 25 16:59:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:59:51 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:59:51 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 16:59:51 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:59:52 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Sep 25 16:59:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:59:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:59:52 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 16:59:52 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 16:59:52 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Sep 25 16:59:52 devstack cinder-volume[76125]: DEBUG oslo_concurrency.processutils [None req-864e5eef-692d-458f-b992-24b637927f6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:59:52 devstack cinder-volume[76125]: DEBUG cinder.manager [None req-864e5eef-692d-458f-b992-24b637927f6e None None] Notifying Schedulers of capabilities ... {{(pid=76125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 16:59:53 devstack cinder-volume[76001]: INFO oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Caught SIGTERM, stopping children Sep 25 16:59:53 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Acquiring lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:59:53 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Acquired lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:59:53 devstack cinder-volume[76001]: DEBUG oslo_concurrency.lockutils [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Releasing lock "singleton_lock" {{(pid=76001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:59:53 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Stop services. {{(pid=76001) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 16:59:53 devstack cinder-volume[76001]: DEBUG oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Killing children. {{(pid=76001) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 16:59:53 devstack cinder-volume[76001]: INFO oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Waiting on 1 children to exit Sep 25 16:59:55 devstack cinder-volume[76125]: DEBUG oslo_concurrency.lockutils [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Acquiring lock "singleton_lock" {{(pid=76125) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:59:55 devstack cinder-volume[76125]: DEBUG oslo_concurrency.lockutils [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Acquired lock "singleton_lock" {{(pid=76125) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:59:55 devstack cinder-volume[76125]: DEBUG oslo_concurrency.lockutils [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Releasing lock "singleton_lock" {{(pid=76125) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:59:55 devstack cinder-volume[76125]: WARNING amqp [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:59:55 devstack cinder-volume[76125]: WARNING amqp [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 16:59:55 devstack cinder-volume[76001]: INFO oslo_service.backend._eventlet.service [None req-56c6fa43-ccbb-4d1c-b59e-6aa74e275970 None None] Child 76125 exited with status 0 Sep 25 16:59:55 devstack cinder-volume[86273]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 16:59:55 devstack cinder-volume[86273]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 16:59:55 devstack cinder-volume[86273]: we strongly recommend against using it for new projects. Sep 25 16:59:55 devstack cinder-volume[86273]: If you are already using Eventlet, we recommend migrating to a different Sep 25 16:59:55 devstack cinder-volume[86273]: framework. For more detail see Sep 25 16:59:55 devstack cinder-volume[86273]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 16:59:55 devstack cinder-volume[86273]: import eventlet # noqa Sep 25 16:59:57 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 16:59:57 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 16:59:57 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 16:59:58 devstack cinder-volume[86273]: INFO dbcounter [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Registered counter for database cinder Sep 25 16:59:58 devstack cinder-volume[86273]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86273) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG dbcounter [-] [86273] Writer thread running {{(pid=86273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 16:59:59 devstack cinder-volume[86273]: INFO cinder.rpc [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 16:59:59 devstack cinder-volume[86273]: INFO cinder.rpc [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86273) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:59:59 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Determined volume DB was empty at startup. Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG cinder.volume.manager [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86273) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 16:59:59 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 16:59:59 devstack cinder-volume[86273]: WARNING stevedore.named [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 16:59:59 devstack cinder-volume[86273]: WARNING castellan.key_manager [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:59:59 devstack cinder-volume[86273]: WARNING cinder.keymgr.conf_key_mgr [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 16:59:59 devstack cinder-volume[86273]: INFO cinder.volume.manager [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86273) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 16:59:59 devstack cinder-volume[86273]: INFO oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Starting 1 workers Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Started child 86581 {{(pid=86273) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Full set of CONF: {{(pid=86273) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] ******************************************************************************** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Configuration options gathered from: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] ================================================================================ {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] allow_availability_zone_fallback = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] allow_compression_on_image_upload = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] allowed_direct_url_schemes = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] api_rate_limit = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] auth_strategy = keystone {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_availability_zone = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_host = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_stats_polling_interval = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backup_api_class = cinder.backup.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backup_name_template = backup-%s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backup_use_same_host = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backup_use_temp_snapshot = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] chap_password = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] chap_username = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cinder_internal_tenant_project_id = eaea8f6f3899424189f96c0f9b204f0e {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cinder_internal_tenant_user_id = 9d8088ff0fda48ea9cf4b7125381f928 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cluster = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] compression_format = gzip {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] compute_api_class = cinder.compute.nova.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86581]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] config_dir = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] config_source = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] control_exchange = openstack {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] debug = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] default_availability_zone = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] default_group_type = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] default_volume_type = QuobyteHD {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] disk_geometry = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] driver_client_cert = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] driver_client_cert_key = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] driver_data_namespace = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] driver_ssl_cert_path = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] driver_ssl_cert_verify = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] driver_use_ssl = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] enable_new_services = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] enable_unsupported_driver = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] enabled_backends = ['QuobyteHD'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] enforce_multipath_for_image_xfer = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] filter_function = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_api_insecure = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_api_servers = ['http://192.168.122.90/image'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_api_ssl_compression = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_ca_certificates_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_catalog_info = image:glance:publicURL {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_keyfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_num_retries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance_request_timeout = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] goodness_function = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] graceful_shutdown_timeout = 5 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] group_api_class = cinder.group.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] host = devstack {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_compress_on_upload = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_conversion_address_space_limit = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_conversion_cpu_limit = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_conversion_disable = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_introspection_address_space_limit = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_introspection_cpu_limit = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_upload_use_cinder_backend = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_upload_use_internal_tenant = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_volume_cache_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_volume_cache_max_count = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] image_volume_cache_max_size_gb = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] init_host_max_objects_retrieval = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] instance_format = [instance: %(uuid)s] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] iscsi_target_flags = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] iscsi_write_cache = on {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] iser_helper = tgtadm {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] iser_ip_address = 192.168.122.90 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] iser_port = 3260 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] log_color = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] log_config_append = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] log_dir = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] log_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] log_options = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] log_rotate_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] log_rotate_interval_type = days {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] log_rotation_type = none {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] max_age = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] max_logfile_count = 30 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] max_logfile_size_mb = 200 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] max_over_subscription_ratio = 20.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] message_reap_interval = 86400 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] message_ttl = 2592000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] migration_create_volume_timeout_secs = 300 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] monkey_patch = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] monkey_patch_modules = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] my_ip = 192.168.122.90 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] no_snapshot_gb_quota = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] num_iser_scan_tries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] num_shell_tries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] num_volume_device_scan_tries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] nvmeof_conn_info_version = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] nvmet_ns_id = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] nvmet_port_id = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] osapi_max_limit = 1000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] osapi_volume_ext_list = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] osapi_volume_listen_port = 8776 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] osapi_volume_use_ssl = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] osapi_volume_workers = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] per_volume_size_limit = -1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] periodic_fuzzy_delay = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] periodic_interval = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] public_endpoint = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] publish_errors = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] quota_backup_gigabytes = 1000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] quota_backups = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] quota_gigabytes = 1000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] quota_groups = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] quota_snapshots = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] quota_volumes = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] rate_limit_burst = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] rate_limit_except_level = CRITICAL {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] rate_limit_interval = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] reinit_driver_count = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] replication_device = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] report_discard_supported = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] report_interval = 120 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] reservation_clean_interval = 86400 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] reservation_expire = 86400 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] reserved_image_namespaces = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] reserved_percentage = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] rpc_response_timeout = 120 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] run_external_periodic_tasks = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] scst_target_driver = iscsi {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] scst_target_iqn_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_down_time = 720 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] shell_completion = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] snapshot_name_template = snapshot-%s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] split_loggers = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] state_path = /opt/stack/data/cinder {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] storage_availability_zone = nova {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] storage_protocol = iSCSI {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] syslog_log_facility = LOG_USER {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] target_helper = lioadm {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] target_ip_address = 192.168.122.90 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] target_port = 3260 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] target_protocol = iscsi {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] target_secondary_ip_addresses = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] trace_flags = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] transport_url = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] until_refresh = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] use_chap_auth = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] use_default_quota_class = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] use_journal = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] use_json = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] use_multipath_for_image_xfer = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] use_stderr = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] use_syslog = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] verify_glance_signatures = enabled {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_api_class = cinder.volume.api.API {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_backend_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_clear = zero {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_clear_ionice = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_clear_size = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_copy_bps_limit = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_dd_blocksize = 1M {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_name_template = volume-%s {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_service_inithost_offload = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volume_usage_audit_period = month {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] zoning_mode = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_concurrency.disable_process_locking = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.auth_section = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.auth_type = password {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.auth_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.cache = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.remotefs [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86581) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.include_service_catalog = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.insecure = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.interface = public {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.keyfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_password = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcache_username = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.region_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.service_type = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.90/identity {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.backend = dogpile.cache.null {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.backend_argument = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.backend_expiration_time = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.config_prefix = cache.oslo {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.debug_cache_backend = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.enable_retry_client = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.enable_socket_keepalive = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.expiration_time = 600 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.hashclient_retry_attempts = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.memcache_dead_retry = 300 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.memcache_pool_maxsize = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.memcache_sasl_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.password = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.proxies = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.redis_db = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.redis_server = localhost:6379 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.retry_attempts = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.retry_delay = 0.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.socket_keepalive_count = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.socket_keepalive_idle = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.socket_keepalive_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.socket_timeout = 1.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.tls_allowed_ciphers = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.tls_cafile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.tls_certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.tls_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.tls_keyfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cache.username = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] coordination.backend_url = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.asyncio_connection = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.asyncio_slave_connection = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.backend = sqlalchemy {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.connection = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.connection_debug = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.connection_parameters = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.connection_recycle_time = 3600 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.connection_trace = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.db_inc_retry_interval = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.db_max_retries = 20 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.db_max_retry_interval = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.db_retry_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.max_overflow = 50 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.max_pool_size = 5 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.max_retries = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.mysql_wsrep_sync_wait = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.pool_timeout = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.retry_interval = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.slave_connection = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.sqlite_synchronous = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.synchronous_reader = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] database.use_db_reconnect = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_tracing.insecure = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.connection_string = messaging:// {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.es_doc_type = notification {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.es_scroll_size = 10000 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.es_scroll_time = 2m {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.filter_error_trace = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.hmac_keys = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.sentinel_service_name = mymaster {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.socket_timeout = 0.1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.trace_requests = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler.trace_sqlalchemy = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler_jaeger.process_tags = {} {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler_jaeger.service_name_prefix = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] profiler_otlp.service_name_prefix = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.enforce_new_defaults = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.policy_default_rule = default {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.policy_file = policy.yaml {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] privsep_osbrick.group = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] privsep_osbrick.helper_command = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] privsep_osbrick.user = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cinder_sys_admin.group = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cinder_sys_admin.helper_command = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] cinder_sys_admin.user = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.auth_section = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.auth_type = password {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.cafile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.collect_timing = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.insecure = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.keyfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.send_service_user_token = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.split_loggers = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.timeout = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.tls_ciphers = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] service_user.tls_min_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.auth_section = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.auth_type = password {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.collect_timing = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.insecure = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.keyfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.region_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.split_loggers = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.timeout = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.tls_ciphers = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] glance.tls_min_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.backend_availability_zone = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.chap_password = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.chap_username = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.disk_geometry = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.driver_client_cert = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.driver_client_cert_key = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.driver_data_namespace = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.driver_use_ssl = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.extra_capabilities = {} {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.filter_function = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.goodness_function = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.iscsi_target_flags = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.iscsi_write_cache = on {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.iser_helper = tgtadm {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.iser_ip_address = 192.168.122.90 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.iser_port = 3260 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_host = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_login = admin {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_mount_options = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_password = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_private_key = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_share_path = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.num_shell_tries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.quobyte_volume_url = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.replication_device = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.report_discard_supported = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.reserved_percentage = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.target_helper = tgtadm {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.target_ip_address = 192.168.122.90 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.target_port = 3260 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.target_protocol = iscsi {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.trace_flags = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.unique_fqdn_network = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.use_chap_auth = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.volume_backend_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.volume_clear = zero {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.volume_clear_ionice = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.volume_clear_size = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86581) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 16:59:59 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 16:59:59 devstack cinder-volume[86581]: WARNING cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 16:59:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Running cmd (subprocess): mount.quobyte {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_reports.file_event_handler = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_reports.log_dir = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.backend_availability_zone = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.backend_host = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.chap_password = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.chap_username = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.chiscsi_conf = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.disk_geometry = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.driver_client_cert = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.driver_data_namespace = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.driver_use_ssl = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.extra_capabilities = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.filter_function = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.goodness_function = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.iser_helper = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.iser_ip_address = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.iser_port = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.iser_target_prefix = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_host = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_login = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_mount_options = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_password = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_private_key = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_share_path = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_ssh_port = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.num_shell_tries = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.nvmet_port_id = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.replication_device = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.report_discard_supported = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.reserved_percentage = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.scst_target_driver = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.storage_protocol = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.target_helper = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.target_ip_address = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.target_port = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.target_prefix = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.target_protocol = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.trace_flags = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.use_chap_auth = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.volume_clear = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.volume_clear_size = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] QuobyteHD.volumes_dir = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.ssl = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_notifications.driver = [] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_notifications.retry = -1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] key_manager.fixed_key = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.barbican_api_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.barbican_endpoint = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.barbican_endpoint_type = public {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.barbican_region_name = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.cafile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.collect_timing = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.insecure = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.keyfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.number_of_retries = 60 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.retry_delay = 1 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.send_service_user_token = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.split_loggers = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.timeout = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.tls_ciphers = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.tls_min_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.verify_ssl = True {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican.verify_ssl_path = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.auth_section = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.auth_type = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.cafile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.certfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.collect_timing = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.insecure = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.keyfile = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.split_loggers = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.timeout = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.tls_ciphers = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] barbican_service_user.tls_min_version = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.approle_role_id = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.approle_secret_id = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.auth_method = approle {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.auth_path = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.kv_mountpoint = secret {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.kv_path = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.kv_version = 2 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.namespace = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.root_token_id = **** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.ssl_ca_crt_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.timeout = 60.0 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 16:59:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.token_file = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.token_role = None {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.use_ssl = False {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 16:59:59 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] ******************************************************************************** {{(pid=86273) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 16:59:59 devstack cinder-volume[86581]: INFO cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b ... Sep 25 16:59:59 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b -c /etc/quobyte/client-cinder.cfg {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:00 devstack sudo[86591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b -c /etc/quobyte/client-cinder.cfg Sep 25 17:00:00 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:00 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.482s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:00 devstack cinder-volume[86581]: INFO cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b succeeded Sep 25 17:00:00 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:00:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.500s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:00:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:00 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:00:00 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:00 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:00 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.306s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:00 devstack cinder-volume[86581]: INFO cinder.volume.driver [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 17:00:00 devstack cinder-volume[86581]: DEBUG cinder.volume.driver [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86581) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 17:00:00 devstack cinder-volume[86581]: DEBUG oslo_db.sqlalchemy.engines [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writer thread running {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG cinder.db.api [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Building query based on filter {{(pid=86581) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG cinder.image.image_utils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86581) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 17:00:01 devstack cinder-volume[86581]: INFO cinder.keymgr.migration [None req-27797933-b4f5-4f69-bf9f-40deb3a1af57 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:01 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:00:01 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:01 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.293s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:00:01 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Driver initialization completed successfully. Sep 25 17:00:01 devstack cinder-volume[86581]: INFO cinder.manager [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Initiating service 3 cleanup Sep 25 17:00:01 devstack cinder-volume[86581]: INFO cinder.manager [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Service 3 cleanup completed. Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG cinder.service [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Creating RPC server for service cinder-volume {{(pid=86581) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG cinder.service [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86581) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 17:00:01 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:00:01 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:01 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:00:01 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:02 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:02 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.450s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:02 devstack cinder-volume[86581]: INFO cinder.volume.manager [None req-f413dad6-41e3-4921-9975-728731fa7373 None None] Driver post RPC initialization completed successfully. Sep 25 17:00:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f125098-c81d-4088-a948-b15736edb802 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:00:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f125098-c81d-4088-a948-b15736edb802 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:00:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8f125098-c81d-4088-a948-b15736edb802 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=86581) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:00:06 devstack cinder-volume[86581]: DEBUG cinder.volume.drivers.quobyte [None req-8f125098-c81d-4088-a948-b15736edb802 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=86581) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:00:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-8f125098-c81d-4088-a948-b15736edb802 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86581) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:00:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f125098-c81d-4088-a948-b15736edb802 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:06 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:00:06 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:06 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:06 devstack cinder-volume[86581]: DEBUG oslo_concurrency.processutils [None req-8f125098-c81d-4088-a948-b15736edb802 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.231s {{(pid=86581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:06 devstack cinder-volume[86581]: DEBUG cinder.manager [None req-8f125098-c81d-4088-a948-b15736edb802 None None] Notifying Schedulers of capabilities ... {{(pid=86581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:00:09 devstack cinder-volume[86273]: INFO oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Caught SIGTERM, stopping children Sep 25 17:00:09 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Acquiring lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:00:09 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Acquired lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:00:09 devstack cinder-volume[86273]: DEBUG oslo_concurrency.lockutils [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Releasing lock "singleton_lock" {{(pid=86273) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:00:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Stop services. {{(pid=86273) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 17:00:09 devstack cinder-volume[86273]: DEBUG oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Killing children. {{(pid=86273) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 17:00:09 devstack cinder-volume[86273]: INFO oslo_service.backend._eventlet.service [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Waiting on 1 children to exit Sep 25 17:00:11 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=3 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:00:12 devstack cinder-volume[86581]: DEBUG dbcounter [-] [86581] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:00:14 devstack cinder-volume[86581]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 25 17:00:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Acquiring lock "singleton_lock" {{(pid=86581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:00:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Acquired lock "singleton_lock" {{(pid=86581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:00:14 devstack cinder-volume[86581]: DEBUG oslo_concurrency.lockutils [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Releasing lock "singleton_lock" {{(pid=86581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:00:15 devstack cinder-volume[86581]: WARNING amqp [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:00:15 devstack cinder-volume[86581]: WARNING amqp [None req-2aa4e689-5abf-48ef-9da6-421dd26b313a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 17:00:15 devstack cinder-volume[86976]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 17:00:15 devstack cinder-volume[86976]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 17:00:15 devstack cinder-volume[86976]: we strongly recommend against using it for new projects. Sep 25 17:00:15 devstack cinder-volume[86976]: If you are already using Eventlet, we recommend migrating to a different Sep 25 17:00:15 devstack cinder-volume[86976]: framework. For more detail see Sep 25 17:00:15 devstack cinder-volume[86976]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 17:00:15 devstack cinder-volume[86976]: import eventlet # noqa Sep 25 17:00:18 devstack cinder-volume[86976]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 17:00:18 devstack cinder-volume[86976]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 17:00:18 devstack cinder-volume[86976]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 17:00:19 devstack cinder-volume[86976]: INFO dbcounter [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Registered counter for database cinder Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_db.sqlalchemy.engines [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG dbcounter [-] [86976] Writer thread running {{(pid=86976) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:00:19 devstack cinder-volume[86976]: INFO cinder.rpc [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 17:00:19 devstack cinder-volume[86976]: INFO cinder.rpc [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_db.sqlalchemy.engines [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:00:19 devstack cinder-volume[86976]: INFO cinder.volume.manager [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Determined volume DB was empty at startup. Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG cinder.volume.manager [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86976) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 17:00:19 devstack cinder-volume[86976]: WARNING stevedore.named [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 17:00:19 devstack cinder-volume[86976]: WARNING castellan.key_manager [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:00:19 devstack cinder-volume[86976]: WARNING cinder.keymgr.conf_key_mgr [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 17:00:19 devstack cinder-volume[86976]: INFO cinder.volume.manager [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_db.sqlalchemy.engines [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:00:19 devstack cinder-volume[86976]: INFO oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Starting 1 workers Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Started child 87232 {{(pid=86976) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Full set of CONF: {{(pid=86976) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] ******************************************************************************** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] Configuration options gathered from: {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] ================================================================================ {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] allow_availability_zone_fallback = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] allow_compression_on_image_upload = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[87232]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] allowed_direct_url_schemes = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] api_rate_limit = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] auth_strategy = keystone {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_availability_zone = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_host = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_stats_polling_interval = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backup_api_class = cinder.backup.api.API {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backup_name_template = backup-%s {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backup_use_same_host = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backup_use_temp_snapshot = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] chap_password = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] chap_username = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cinder_internal_tenant_project_id = eaea8f6f3899424189f96c0f9b204f0e {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cinder_internal_tenant_user_id = 9d8088ff0fda48ea9cf4b7125381f928 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cluster = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] compression_format = gzip {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] compute_api_class = cinder.compute.nova.API {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] config_dir = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] config_source = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] control_exchange = openstack {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] debug = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] default_availability_zone = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] default_group_type = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] default_volume_type = QuobyteHD {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] disk_geometry = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] driver_client_cert = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] driver_client_cert_key = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] driver_data_namespace = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] driver_ssl_cert_path = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] driver_ssl_cert_verify = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] driver_use_ssl = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] enable_new_services = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] enable_unsupported_driver = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] enabled_backends = ['QuobyteHD'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] enforce_multipath_for_image_xfer = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] filter_function = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_api_insecure = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_api_servers = ['http://192.168.122.90/image'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_api_ssl_compression = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_ca_certificates_file = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_catalog_info = image:glance:publicURL {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_certfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_keyfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_num_retries = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance_request_timeout = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] goodness_function = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] graceful_shutdown_timeout = 5 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] group_api_class = cinder.group.api.API {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] host = devstack {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_compress_on_upload = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_conversion_address_space_limit = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_conversion_cpu_limit = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_conversion_disable = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_introspection_address_space_limit = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_introspection_cpu_limit = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_upload_use_cinder_backend = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_upload_use_internal_tenant = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_volume_cache_enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_volume_cache_max_count = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] image_volume_cache_max_size_gb = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] init_host_max_objects_retrieval = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] instance_format = [instance: %(uuid)s] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] iscsi_target_flags = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] iscsi_write_cache = on {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] iser_helper = tgtadm {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] iser_ip_address = 192.168.122.90 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] iser_port = 3260 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] log_color = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] log_config_append = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] log_dir = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] log_file = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] log_options = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] log_rotate_interval = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] log_rotate_interval_type = days {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] log_rotation_type = none {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] max_age = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] max_logfile_count = 30 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] max_logfile_size_mb = 200 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] max_over_subscription_ratio = 20.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] message_reap_interval = 86400 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] message_ttl = 2592000 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] migration_create_volume_timeout_secs = 300 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] monkey_patch = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] monkey_patch_modules = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] my_ip = 192.168.122.90 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] no_snapshot_gb_quota = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] num_iser_scan_tries = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] num_shell_tries = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] num_volume_device_scan_tries = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] nvmeof_conn_info_version = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] nvmet_ns_id = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] nvmet_port_id = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] osapi_max_limit = 1000 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] osapi_volume_ext_list = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] osapi_volume_listen_port = 8776 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] osapi_volume_use_ssl = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] osapi_volume_workers = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] per_volume_size_limit = -1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] periodic_fuzzy_delay = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] periodic_interval = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] public_endpoint = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] publish_errors = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87232) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] quota_backup_gigabytes = 1000 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] quota_backups = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] quota_gigabytes = 1000 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] quota_groups = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] quota_snapshots = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] quota_volumes = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] rate_limit_burst = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] rate_limit_except_level = CRITICAL {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] rate_limit_interval = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] reinit_driver_count = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] replication_device = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] report_discard_supported = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] report_interval = 120 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] reservation_clean_interval = 86400 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] reservation_expire = 86400 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] reserved_image_namespaces = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] reserved_percentage = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] rpc_response_timeout = 120 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] run_external_periodic_tasks = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] scst_target_driver = iscsi {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] scst_target_iqn_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_down_time = 720 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] shell_completion = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] snapshot_name_template = snapshot-%s {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] split_loggers = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] state_path = /opt/stack/data/cinder {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] storage_availability_zone = nova {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] storage_protocol = iSCSI {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] syslog_log_facility = LOG_USER {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] target_helper = lioadm {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] target_ip_address = 192.168.122.90 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] target_port = 3260 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] target_protocol = iscsi {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] target_secondary_ip_addresses = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] trace_flags = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] transport_url = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] until_refresh = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] use_chap_auth = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] use_default_quota_class = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] use_journal = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] use_json = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] use_multipath_for_image_xfer = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] use_stderr = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] use_syslog = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] verify_glance_signatures = enabled {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_api_class = cinder.volume.api.API {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_backend_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_clear = zero {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_clear_ionice = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_clear_size = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_copy_bps_limit = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_dd_blocksize = 1M {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_name_template = volume-%s {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_service_inithost_offload = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volume_usage_audit_period = month {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] zoning_mode = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_concurrency.disable_process_locking = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.auth_section = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.auth_type = password {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.auth_version = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.cache = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.certfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.include_service_catalog = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.insecure = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.interface = public {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.keyfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_password = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcache_username = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.region_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.service_type = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.90/identity {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.backend = dogpile.cache.null {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.backend_argument = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.backend_expiration_time = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.config_prefix = cache.oslo {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.debug_cache_backend = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.enable_retry_client = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.enable_socket_keepalive = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.expiration_time = 600 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.hashclient_retry_attempts = 2 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.memcache_dead_retry = 300 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.memcache_pool_maxsize = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.memcache_sasl_enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.password = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.proxies = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.redis_db = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.redis_server = localhost:6379 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.retry_attempts = 2 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.retry_delay = 0.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.socket_keepalive_count = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.socket_keepalive_idle = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.socket_keepalive_interval = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.socket_timeout = 1.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.tls_allowed_ciphers = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.tls_cafile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.tls_certfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.tls_enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.tls_keyfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cache.username = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] coordination.backend_url = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.asyncio_connection = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.asyncio_slave_connection = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.backend = sqlalchemy {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.connection = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.connection_debug = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.connection_parameters = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.connection_recycle_time = 3600 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.connection_trace = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.db_inc_retry_interval = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.db_max_retries = 20 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.db_max_retry_interval = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.db_retry_interval = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.max_overflow = 50 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.max_pool_size = 5 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.max_retries = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.mysql_wsrep_sync_wait = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.pool_timeout = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.retry_interval = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.slave_connection = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.sqlite_synchronous = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.synchronous_reader = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] database.use_db_reconnect = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_tracing.insecure = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.connection_string = messaging:// {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.es_doc_type = notification {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.es_scroll_size = 10000 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.es_scroll_time = 2m {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.filter_error_trace = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.hmac_keys = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.sentinel_service_name = mymaster {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.socket_timeout = 0.1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.trace_requests = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler.trace_sqlalchemy = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler_jaeger.process_tags = {} {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler_jaeger.service_name_prefix = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] profiler_otlp.service_name_prefix = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.enforce_new_defaults = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.policy_default_rule = default {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87232) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.quobyte [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.policy_file = policy.yaml {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.quobyte [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] privsep_osbrick.group = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] privsep_osbrick.helper_command = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] privsep_osbrick.user = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cinder_sys_admin.group = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cinder_sys_admin.helper_command = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] cinder_sys_admin.user = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.auth_section = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.auth_type = password {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Running cmd (subprocess): mount.quobyte {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.cafile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.certfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.collect_timing = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.insecure = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.keyfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.send_service_user_token = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.split_loggers = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.timeout = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.tls_ciphers = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] service_user.tls_min_version = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.auth_section = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.auth_type = password {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.certfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.collect_timing = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.insecure = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.keyfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.region_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.split_loggers = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.timeout = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.tls_ciphers = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] glance.tls_min_version = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.backend_availability_zone = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.chap_password = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.chap_username = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.disk_geometry = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.driver_client_cert = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.driver_client_cert_key = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.driver_data_namespace = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.driver_use_ssl = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.extra_capabilities = {} {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.filter_function = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.goodness_function = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.iscsi_target_flags = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.iscsi_write_cache = on {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.iser_helper = tgtadm {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.iser_ip_address = 192.168.122.90 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.iser_port = 3260 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_host = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_login = admin {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_mount_options = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_password = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_private_key = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_share_path = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.num_shell_tries = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.quobyte_volume_url = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.replication_device = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.report_discard_supported = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.reserved_percentage = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.target_helper = tgtadm {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.target_ip_address = 192.168.122.90 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.target_port = 3260 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.target_protocol = iscsi {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.trace_flags = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.unique_fqdn_network = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.use_chap_auth = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.volume_backend_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.volume_clear = zero {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.volume_clear_ionice = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.volume_clear_size = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_reports.file_event_handler = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_reports.log_dir = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.backend_availability_zone = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.backend_host = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.chap_password = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.chap_username = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.chiscsi_conf = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.disk_geometry = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.driver_client_cert = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.driver_data_namespace = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.driver_use_ssl = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.extra_capabilities = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.filter_function = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.goodness_function = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.iser_helper = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.iser_ip_address = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.iser_port = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.iser_target_prefix = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_host = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_login = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_mount_options = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_password = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_private_key = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_share_path = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_ssh_port = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.num_shell_tries = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.nvmet_port_id = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.replication_device = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.report_discard_supported = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.reserved_percentage = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.scst_target_driver = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.storage_protocol = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.target_helper = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.target_ip_address = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.target_port = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.target_prefix = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.target_protocol = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.trace_flags = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.use_chap_auth = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.volume_clear = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.volume_clear_size = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] QuobyteHD.volumes_dir = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack quobyte-client[87233]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack quobyte-client[87233]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.ssl = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_notifications.driver = [] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_notifications.retry = -1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] key_manager.fixed_key = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.barbican_api_version = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.barbican_endpoint = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.barbican_endpoint_type = public {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.barbican_region_name = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.cafile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.certfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.collect_timing = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.insecure = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.keyfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.number_of_retries = 60 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.retry_delay = 1 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.send_service_user_token = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.split_loggers = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.timeout = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.tls_ciphers = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.tls_min_version = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.verify_ssl = True {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican.verify_ssl_path = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.auth_section = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.auth_type = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.cafile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.certfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.collect_timing = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.insecure = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.keyfile = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.split_loggers = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.timeout = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.tls_ciphers = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] barbican_service_user.tls_min_version = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.approle_role_id = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.approle_secret_id = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.auth_method = approle {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.auth_path = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.kv_mountpoint = secret {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.kv_path = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.kv_version = 2 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.namespace = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.root_token_id = **** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.ssl_ca_crt_file = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.timeout = 60.0 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.token_file = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.token_role = None {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.use_ssl = False {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 17:00:19 devstack cinder-volume[86976]: DEBUG oslo_service.backend._eventlet.service [None req-92b115c9-e331-4f82-9969-b3206ca65fcb None None] ******************************************************************************** {{(pid=86976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 17:00:19 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:00:19 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:20 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:20 devstack cinder-volume[87232]: INFO cinder.volume.driver [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Driver hasn't implemented _init_vendor_properties() Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.volume.driver [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87232) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_db.sqlalchemy.engines [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writer thread running {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.db.api [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Building query based on filter {{(pid=87232) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87232) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:20 devstack cinder-volume[87232]: INFO cinder.keymgr.migration [None req-4fbe914c-d0b9-4466-aa16-1ed3660d32dc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 17:00:20 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:00:20 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:20 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.262s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:00:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Driver initialization completed successfully. Sep 25 17:00:20 devstack cinder-volume[87232]: INFO cinder.manager [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Initiating service 3 cleanup Sep 25 17:00:20 devstack cinder-volume[87232]: INFO cinder.manager [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Service 3 cleanup completed. Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.service [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Creating RPC server for service cinder-volume {{(pid=87232) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.service [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87232) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 17:00:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:00:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:00:20 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:00:20 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:00:21 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Sep 25 17:00:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:00:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7f0fc2b5-2417-444a-93b9-76e09a1eaabd None None] Driver post RPC initialization completed successfully. Sep 25 17:00:29 devstack cinder-volume[86976]: DEBUG dbcounter [-] [86976] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86976) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:00:30 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:00:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:00:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:00:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 6 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:00:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:01:39 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:01:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Flow 'volume_create_manager' (bdf89180-1bf9-4967-8846-3b77e37099f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:01:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05a0bb2-8a40-4e61-ac5c-12a9a5b6b6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05a0bb2-8a40-4e61-ac5c-12a9a5b6b6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-741206692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb1b77d-4776-45dc-bba7-f803da12d6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51be6b39213046bc90e3f7dc4dcc2e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:01:40Z,use_quota=True,user_id='5f4ac272f86e4e8bb055c7d6c0dcf107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90dec66-df71-4235-abd2-003b833dc418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90dec66-df71-4235-abd2-003b833dc418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0afb0e-9853-4e5b-bfbd-c0db074b2d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0afb0e-9853-4e5b-bfbd-c0db074b2d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb1b77d-4776-45dc-bba7-f803da12d6f2', 'volume_name': 'volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa362f3f-7510-4742-9f2f-0338c66e3f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa362f3f-7510-4742-9f2f-0338c66e3f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3eeb49-2efd-47aa-97ea-bc230b4cb7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Volume dfb1b77d-4776-45dc-bba7-f803da12d6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2', 'volume_size': 1} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-741206692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb1b77d-4776-45dc-bba7-f803da12d6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51be6b39213046bc90e3f7dc4dcc2e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:01:40Z,use_quota=True,user_id='5f4ac272f86e4e8bb055c7d6c0dcf107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Creating volume dfb1b77d-4776-45dc-bba7-f803da12d6f2 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:01:40 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:01:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:01:40 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 1073741824 Sep 25 17:01:40 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:01:42 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Sep 25 17:01:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 1073741824" returned: 0 in 1.598s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:01:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:01:42 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 Sep 25 17:01:42 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:01:42 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Sep 25 17:01:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:01:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:01:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:01:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3eeb49-2efd-47aa-97ea-bc230b4cb7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad02a5c-0dcc-4281-8455-f963e4dbe168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Volume volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 (dfb1b77d-4776-45dc-bba7-f803da12d6f2): created successfully Sep 25 17:01:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad02a5c-0dcc-4281-8455-f963e4dbe168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Flow 'volume_create_manager' (bdf89180-1bf9-4967-8846-3b77e37099f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:01:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2cc09a98-966e-49ec-af3e-07b993ad8a0d tempest-DeleteServersTestJSON-316660630 None] Created volume successfully. Sep 25 17:01:50 devstack cinder-volume[87232]: WARNING py.warnings [req-8b61e8d9-0a2a-4299-a5f3-a66776260181 req-b6e4d67c-4566-4b2e-9b02-9cb64c0b3742 tempest-DeleteServersTestJSON-316660630 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 25 17:01:50 devstack cinder-volume[87232]: .first() Sep 25 17:01:50 devstack cinder-volume[87232]: Sep 25 17:01:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8b61e8d9-0a2a-4299-a5f3-a66776260181 req-b6e4d67c-4566-4b2e-9b02-9cb64c0b3742 tempest-DeleteServersTestJSON-316660630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:01:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8b61e8d9-0a2a-4299-a5f3-a66776260181 req-b6e4d67c-4566-4b2e-9b02-9cb64c0b3742 tempest-DeleteServersTestJSON-316660630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:01:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8b61e8d9-0a2a-4299-a5f3-a66776260181 req-b6e4d67c-4566-4b2e-9b02-9cb64c0b3742 tempest-DeleteServersTestJSON-316660630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:01:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-8b61e8d9-0a2a-4299-a5f3-a66776260181 req-b6e4d67c-4566-4b2e-9b02-9cb64c0b3742 tempest-DeleteServersTestJSON-316660630 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ff5dbfe-62e4-472e-b1e4-b976de347cb4', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:01:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-8b61e8d9-0a2a-4299-a5f3-a66776260181 req-b6e4d67c-4566-4b2e-9b02-9cb64c0b3742 tempest-DeleteServersTestJSON-316660630 None] attachment_update completed successfully. Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:01:56 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:01:56 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:01:56 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.528s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 6 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:01:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:01:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-7f226e6b-21b0-4164-9a1b-13a8630f6e5a req-f8a73f8d-cb15-4dfb-9eb0-33ef195a1c97 tempest-DeleteServersTestJSON-316660630 None] Terminate volume connection completed successfully. Sep 25 17:01:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-7f226e6b-21b0-4164-9a1b-13a8630f6e5a req-f8a73f8d-cb15-4dfb-9eb0-33ef195a1c97 tempest-DeleteServersTestJSON-316660630 None] Deleting attachment 9ff5dbfe-62e4-472e-b1e4-b976de347cb4. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Flow 'volume_create_manager' (76e73284-9fb1-4aba-a5ab-74f3b3a337ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c00e37c-868f-4ff9-84fd-82791de68670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c00e37c-868f-4ff9-84fd-82791de68670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1891444113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e57659-4226-4668-af40-ff4c9f9625a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb24b76462e428eaecfe8a339654e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:00Z,use_quota=True,user_id='69ecaa994f75451ab7d1a75a5847ee63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fe75e2-d79a-4321-a5e3-8ff720f16beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fe75e2-d79a-4321-a5e3-8ff720f16beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7573b47a-cc8a-4c8f-b390-8e8280c3a5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7573b47a-cc8a-4c8f-b390-8e8280c3a5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e57659-4226-4668-af40-ff4c9f9625a8', 'volume_name': 'volume-71e57659-4226-4668-af40-ff4c9f9625a8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1306f6-59f2-4cfd-84fc-ae4f6af5f5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1306f6-59f2-4cfd-84fc-ae4f6af5f5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3ef621-2d1d-4731-8d70-1c1150a7508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:01:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Volume 71e57659-4226-4668-af40-ff4c9f9625a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e57659-4226-4668-af40-ff4c9f9625a8', 'volume_size': 1} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1891444113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e57659-4226-4668-af40-ff4c9f9625a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb24b76462e428eaecfe8a339654e9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:00Z,use_quota=True,user_id='69ecaa994f75451ab7d1a75a5847ee63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Creating volume 71e57659-4226-4668-af40-ff4c9f9625a8 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:01:59 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:01:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:01:59 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8 1073741824 Sep 25 17:01:59 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:00 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8 1073741824" returned: 0 in 0.676s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:00 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8 Sep 25 17:02:00 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:01 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8" returned: 0 in 0.508s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3ef621-2d1d-4731-8d70-1c1150a7508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e57659-4226-4668-af40-ff4c9f9625a8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c822c6-7814-4620-a6bb-0d297650405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:02:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Volume volume-71e57659-4226-4668-af40-ff4c9f9625a8 (71e57659-4226-4668-af40-ff4c9f9625a8): created successfully Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c822c6-7814-4620-a6bb-0d297650405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Flow 'volume_create_manager' (76e73284-9fb1-4aba-a5ab-74f3b3a337ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Acquiring lock "cinder-dfb1b77d-4776-45dc-bba7-f803da12d6f2-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Lock "cinder-dfb1b77d-4776-45dc-bba7-f803da12d6f2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:02:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-348e089e-a7ee-4747-a082-e09c5bdc7955 tempest-VolumesAdminNegativeTest-1078297487 None] Created volume successfully. Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Acquiring lock "cinder-quobyte-dfb1b77d-4776-45dc-bba7-f803da12d6f2" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:02:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Lock "cinder-quobyte-dfb1b77d-4776-45dc-bba7-f803da12d6f2" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:02:01 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvekd8uzi/privsep.sock'] Sep 25 17:02:01 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvekd8uzi/privsep.sock Sep 25 17:02:01 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Acquiring lock "cinder-71e57659-4226-4668-af40-ff4c9f9625a8-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:02:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "cinder-71e57659-4226-4668-af40-ff4c9f9625a8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:02:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Acquiring lock "cinder-quobyte-71e57659-4226-4668-af40-ff4c9f9625a8" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:02:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "cinder-quobyte-71e57659-4226-4668-af40-ff4c9f9625a8" acquired by "delete_volume" :: waited 0.055s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 17:02:03 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:03 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Spawned new privsep daemon via rootwrap Sep 25 17:02:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Accepted privsep connection to /tmp/tmpvekd8uzi/privsep.sock {{(pid=87232) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 17:02:03 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 17:02:03 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 17:02:03 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 17:02:03 devstack cinder-volume[87232]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88691 Sep 25 17:02:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b2bc60-4aad-4eea-96bb-e9fe0490ef71]: (2,) {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:02:03 devstack cinder-volume[87232]: WARNING oslo_privsep.priv_context [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] privsep daemon already running Sep 25 17:02:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf47898c-6a84-4574-bfb2-f1cccf8691e4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:02:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a96a1-00e0-47ba-9b99-ddaf9b3542d0]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:02:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:03 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 Sep 25 17:02:03 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:03 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8 Sep 25 17:02:03 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:04 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2" returned: 0 in 0.767s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:04 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2 Sep 25 17:02:04 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:04 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8" returned: 0 in 0.925s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:04 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8 Sep 25 17:02:04 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:04 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfb1b77d-4776-45dc-bba7-f803da12d6f2" returned: 0 in 0.510s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Lock "cinder-quobyte-dfb1b77d-4776-45dc-bba7-f803da12d6f2" released by "delete_volume" :: held 3.237s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:02:04 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-71e57659-4226-4668-af40-ff4c9f9625a8" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "cinder-quobyte-71e57659-4226-4668-af40-ff4c9f9625a8" released by "delete_volume" :: held 2.064s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:02:04 devstack cinder-volume[87232]: WARNING cinder.quota [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:02:04 devstack cinder-volume[87232]: WARNING cinder.quota [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Created reservations ['2a4f8dd4-c2d3-4abd-a2cf-b2d04ec6b8f1', 'b344920d-2a22-4666-8e54-d8cd9fa3747c', 'dc602851-d958-4732-b240-24267e8971d6', 'e8e2bd93-937a-4a24-8d48-b417bfc4c2c4'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:02:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Created reservations ['fd4d5860-36b4-4d33-a0fc-8beb389248e2', '804f5866-4cae-42ec-840f-a96c009625d7', '35e1ddde-65b2-4667-be26-2d69ae4d0474', '392fef32-f87f-4b2c-a43f-eb84ae238d6e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:05 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:02:05 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:05 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:02:05 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:05 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:05 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:02:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Deleted volume successfully. Sep 25 17:02:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Deleted volume successfully. Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b74bc417-3287-4758-844b-72ca3eaaf795 tempest-DeleteServersTestJSON-316660630 None] Lock "cinder-dfb1b77d-4776-45dc-bba7-f803da12d6f2-delete_volume" released by "delete_volume" :: held 4.222s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:02:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bf8eeb4-6f45-4b7f-b97a-501fee9c02c3 tempest-VolumesAdminNegativeTest-1078297487 None] Lock "cinder-71e57659-4226-4668-af40-ff4c9f9625a8-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Flow 'volume_create_manager' (ac129fb2-a934-4236-9074-b99ed5fd2340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d966107d-2566-40bd-a3e0-5dd2fe3c4a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d966107d-2566-40bd-a3e0-5dd2fe3c4a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-622432030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e266f3d-380f-4206-a6c7-4dd3b1861a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0872ca676a414c3ea838dd81de400d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:09Z,use_quota=True,user_id='f715c25b89664dcba82ffa294fac0efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b331b9b0-d149-4c54-8092-2fccb28ed166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b331b9b0-d149-4c54-8092-2fccb28ed166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f366a380-cbbd-4c00-be37-677b574e739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f366a380-cbbd-4c00-be37-677b574e739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e266f3d-380f-4206-a6c7-4dd3b1861a67', 'volume_name': 'volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe4f665-8943-40e9-ae0a-6faea6248789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe4f665-8943-40e9-ae0a-6faea6248789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a20f996-8f4c-4a07-b213-511e0a3d6d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:02:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Volume 7e266f3d-380f-4206-a6c7-4dd3b1861a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67', 'volume_size': 1} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-622432030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e266f3d-380f-4206-a6c7-4dd3b1861a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0872ca676a414c3ea838dd81de400d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:02:09Z,use_quota=True,user_id='f715c25b89664dcba82ffa294fac0efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Creating volume 7e266f3d-380f-4206-a6c7-4dd3b1861a67 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:02:09 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:02:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:09 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 1073741824 Sep 25 17:02:09 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:10 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 1073741824" returned: 0 in 0.686s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:10 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 Sep 25 17:02:10 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:10 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67" returned: 0 in 0.392s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:02:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a20f996-8f4c-4a07-b213-511e0a3d6d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:02:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adcbf99-f62c-4cc7-8886-4bb3996dea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:02:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Volume volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 (7e266f3d-380f-4206-a6c7-4dd3b1861a67): created successfully Sep 25 17:02:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adcbf99-f62c-4cc7-8886-4bb3996dea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:02:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Flow 'volume_create_manager' (ac129fb2-a934-4236-9074-b99ed5fd2340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:02:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-862976bb-a8da-4092-af4f-ead987f627d4 tempest-ServerActionsTestOtherA-1752418897 None] Created volume successfully. Sep 25 17:02:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b4763d0-6743-4c7a-9472-f85ee4d68346 tempest-BackendsCapabilitiesAdminTestsJSON-1422549787 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87232) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 17:02:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-377f892f-ce18-474b-834e-4feb38ca7336 tempest-BackendsCapabilitiesAdminTestsJSON-1422549787 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87232) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 17:02:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=26,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:02:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:02:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:02:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:02:56 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:02:56 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:02:56 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.833s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 9 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:02:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:03:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a25ab369-eff1-43bb-87d7-5e232bf8a8d4 req-f55a3b3f-5ac0-4b1a-9fca-cb3f519d66cc tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a25ab369-eff1-43bb-87d7-5e232bf8a8d4 req-f55a3b3f-5ac0-4b1a-9fca-cb3f519d66cc tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a25ab369-eff1-43bb-87d7-5e232bf8a8d4 req-f55a3b3f-5ac0-4b1a-9fca-cb3f519d66cc tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-a25ab369-eff1-43bb-87d7-5e232bf8a8d4 req-f55a3b3f-5ac0-4b1a-9fca-cb3f519d66cc tempest-ServerActionsTestOtherA-1752418897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '185eea65-2d6e-4387-992b-3e26b0ab3609', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:03:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-a25ab369-eff1-43bb-87d7-5e232bf8a8d4 req-f55a3b3f-5ac0-4b1a-9fca-cb3f519d66cc tempest-ServerActionsTestOtherA-1752418897 None] attachment_update completed successfully. Sep 25 17:03:07 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:03:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Flow 'volume_create_manager' (8d69bc1e-7c97-4f8b-8c9e-24dfb524dda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:03:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b329e9a-f0b7-46d2-af01-82ac63382a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b329e9a-f0b7-46d2-af01-82ac63382a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-343826305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc85c4a-8cbe-41f1-846e-0c42ae13fb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff5bff4cc42492eb019cf60dac36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:08Z,use_quota=True,user_id='d24dac4de4dc449c9bae97c47a0703d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a9546e-075a-43cc-ac25-4f1fee3227d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a9546e-075a-43cc-ac25-4f1fee3227d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d16d6e1-c12a-41f3-b2d8-6dc14a41aeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d16d6e1-c12a-41f3-b2d8-6dc14a41aeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc85c4a-8cbe-41f1-846e-0c42ae13fb49', 'volume_name': 'volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165ac0ac-198f-4bd1-bbee-3ed987066d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165ac0ac-198f-4bd1-bbee-3ed987066d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad82ad0-f4d3-449d-b207-92cde9f3afd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Volume fbc85c4a-8cbe-41f1-846e-0c42ae13fb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49', 'volume_size': 1} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-343826305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc85c4a-8cbe-41f1-846e-0c42ae13fb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff5bff4cc42492eb019cf60dac36966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:08Z,use_quota=True,user_id='d24dac4de4dc449c9bae97c47a0703d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Creating volume fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:03:08 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:03:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:08 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 1073741824 Sep 25 17:03:08 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:09 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 1073741824" returned: 0 in 1.142s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:09 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 Sep 25 17:03:09 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:10 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49" returned: 0 in 0.893s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:03:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad82ad0-f4d3-449d-b207-92cde9f3afd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd394df-e683-4676-a180-bec507357a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Volume volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 (fbc85c4a-8cbe-41f1-846e-0c42ae13fb49): created successfully Sep 25 17:03:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd394df-e683-4676-a180-bec507357a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Flow 'volume_create_manager' (8d69bc1e-7c97-4f8b-8c9e-24dfb524dda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:03:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-63691180-b9db-4275-b58c-2728d422d43f tempest-ServerRescueNegativeTestJSON-758590300 None] Created volume successfully. Sep 25 17:03:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-5c5d2eab-be75-4798-a7a2-161d2d42466f req-909e2587-446d-47fd-9a45-6971cf70718e tempest-ServerActionsTestOtherA-1752418897 None] Terminate volume connection completed successfully. Sep 25 17:03:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-5c5d2eab-be75-4798-a7a2-161d2d42466f req-909e2587-446d-47fd-9a45-6971cf70718e tempest-ServerActionsTestOtherA-1752418897 None] Deleting attachment 185eea65-2d6e-4387-992b-3e26b0ab3609. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:03:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-5c5d2eab-be75-4798-a7a2-161d2d42466f req-8c9b3694-939b-420c-aa1f-948696a4a909 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-5c5d2eab-be75-4798-a7a2-161d2d42466f req-8c9b3694-939b-420c-aa1f-948696a4a909 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-5c5d2eab-be75-4798-a7a2-161d2d42466f req-8c9b3694-939b-420c-aa1f-948696a4a909 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-5c5d2eab-be75-4798-a7a2-161d2d42466f req-8c9b3694-939b-420c-aa1f-948696a4a909 tempest-ServerActionsTestOtherA-1752418897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a2141ea-6728-47d3-a8bd-4ca148b8bc2d', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:03:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-5c5d2eab-be75-4798-a7a2-161d2d42466f req-8c9b3694-939b-420c-aa1f-948696a4a909 tempest-ServerActionsTestOtherA-1752418897 None] attachment_update completed successfully. Sep 25 17:03:23 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:03:23 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Flow 'volume_create_manager' (506b1f0f-1ff7-4202-9168-d69b3af4c121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41400f36-bac2-4897-96b7-b6d68d89bb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41400f36-bac2-4897-96b7-b6d68d89bb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1823958842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfc573d-118d-45df-8d08-91b2757476ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a2087ca9f04af182aac275297c38b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:38Z,use_quota=True,user_id='754158179ee441d985411e1ae00cd729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830a1c7c-85fa-40b7-b648-40cfc808cb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830a1c7c-85fa-40b7-b648-40cfc808cb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b02edc-dd0f-4cd0-9e26-737d762d4ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b02edc-dd0f-4cd0-9e26-737d762d4ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dfc573d-118d-45df-8d08-91b2757476ad', 'volume_name': 'volume-3dfc573d-118d-45df-8d08-91b2757476ad', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1314c2cb-4503-44c1-916f-f4553682b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1314c2cb-4503-44c1-916f-f4553682b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a9e505-5d88-4aeb-a897-6f03ff81b750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Volume 3dfc573d-118d-45df-8d08-91b2757476ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dfc573d-118d-45df-8d08-91b2757476ad', 'volume_size': 1} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1823958842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfc573d-118d-45df-8d08-91b2757476ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a2087ca9f04af182aac275297c38b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:38Z,use_quota=True,user_id='754158179ee441d985411e1ae00cd729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Creating volume 3dfc573d-118d-45df-8d08-91b2757476ad {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:03:38 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:03:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:38 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad 1073741824 Sep 25 17:03:38 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:39 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad 1073741824" returned: 0 in 0.968s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:39 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad Sep 25 17:03:39 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:39 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:03:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a9e505-5d88-4aeb-a897-6f03ff81b750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dfc573d-118d-45df-8d08-91b2757476ad', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afef25ed-1129-4aa1-a34e-d72afc3dea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Volume volume-3dfc573d-118d-45df-8d08-91b2757476ad (3dfc573d-118d-45df-8d08-91b2757476ad): created successfully Sep 25 17:03:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afef25ed-1129-4aa1-a34e-d72afc3dea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Flow 'volume_create_manager' (506b1f0f-1ff7-4202-9168-d69b3af4c121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:03:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-03a08e37-c775-4d1f-b1bc-7d24e8efc183 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Created volume successfully. Sep 25 17:03:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Acquiring lock "cinder-3dfc573d-118d-45df-8d08-91b2757476ad-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:03:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "cinder-3dfc573d-118d-45df-8d08-91b2757476ad-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:03:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Acquiring lock "cinder-quobyte-3dfc573d-118d-45df-8d08-91b2757476ad" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:03:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "cinder-quobyte-3dfc573d-118d-45df-8d08-91b2757476ad" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce514c0-a3e2-4422-a25e-06e891f27607]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Acquiring lock "cinder-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "cinder-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Acquiring lock "cinder-quobyte-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:03:41 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad Sep 25 17:03:41 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "cinder-quobyte-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8a3429-440d-48bd-bec2-974ada406355]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:41 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 Sep 25 17:03:41 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:41 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad" returned: 0 in 0.905s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:41 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad Sep 25 17:03:41 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:42 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49" returned: 0 in 0.767s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:42 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49 Sep 25 17:03:42 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:42 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3dfc573d-118d-45df-8d08-91b2757476ad" returned: 0 in 0.449s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "cinder-quobyte-3dfc573d-118d-45df-8d08-91b2757476ad" released by "delete_volume" :: held 1.473s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Created reservations ['95fc6836-54bf-4510-8830-7843d1e94118', '0471bf7b-a8e0-4e67-b2c1-45b5ca181984', '6f5077e5-eb6b-475d-bbd2-3bcbda29f8d4', '2dcced13-18e0-4100-bc62-638a497ce710'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:03:42 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49" returned: 0 in 0.428s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "cinder-quobyte-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49" released by "delete_volume" :: held 1.357s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:42 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Created reservations ['41739918-98b9-40c9-ab91-4923098f54df', 'c73b1d77-d648-47ba-9c09-ca8844b54c8a', '6bf062db-d457-4272-a3d0-d9248f353b9a', 'dad3559a-1eeb-43b9-ac12-d2d8c1d8eb46'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:03:42 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:03:42 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:43 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:03:43 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:43 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.535s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:03:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Deleted volume successfully. Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3cd2c322-155f-4ce1-954f-8d3c40458e29 tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "cinder-3dfc573d-118d-45df-8d08-91b2757476ad-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:03:43 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.743s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:03:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Deleted volume successfully. Sep 25 17:03:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8cffeca3-2849-47eb-8128-f03e98ab8186 tempest-ServerRescueNegativeTestJSON-758590300 None] Lock "cinder-fbc85c4a-8cbe-41f1-846e-0c42ae13fb49-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:03:44 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:03:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Flow 'volume_create_manager' (39cd80b5-1240-48e9-8e1f-0e9fb66549bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e86cad5-5070-4576-af8a-0e962e3b64d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e86cad5-5070-4576-af8a-0e962e3b64d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1204479150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e286fc-b72f-4a97-a8bd-edcfd1b23caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a2087ca9f04af182aac275297c38b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:45Z,use_quota=True,user_id='754158179ee441d985411e1ae00cd729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231c1b52-9f49-4a0e-b366-c97da0281680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231c1b52-9f49-4a0e-b366-c97da0281680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8217e7-8248-4c26-a685-c2356699497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8217e7-8248-4c26-a685-c2356699497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e286fc-b72f-4a97-a8bd-edcfd1b23caf', 'volume_name': 'volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb40f81-a95c-45f0-aedd-9292d783358e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb40f81-a95c-45f0-aedd-9292d783358e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a64045-8229-44bf-955a-37993cf61642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Volume 84e286fc-b72f-4a97-a8bd-edcfd1b23caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf', 'volume_size': 1} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1204479150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e286fc-b72f-4a97-a8bd-edcfd1b23caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a2087ca9f04af182aac275297c38b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:45Z,use_quota=True,user_id='754158179ee441d985411e1ae00cd729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Creating volume 84e286fc-b72f-4a97-a8bd-edcfd1b23caf {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:03:45 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:03:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:45 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf 1073741824 Sep 25 17:03:45 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:46 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf 1073741824" returned: 0 in 0.956s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:46 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf Sep 25 17:03:46 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:46 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf" returned: 0 in 0.511s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:03:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a64045-8229-44bf-955a-37993cf61642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898b2120-c126-4c82-b3e1-23ea6bde785f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Volume volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf (84e286fc-b72f-4a97-a8bd-edcfd1b23caf): created successfully Sep 25 17:03:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898b2120-c126-4c82-b3e1-23ea6bde785f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Flow 'volume_create_manager' (39cd80b5-1240-48e9-8e1f-0e9fb66549bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:03:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c4015456-4730-49ed-99ac-81527613a58c tempest-VolumeQuotasAdminTestJSON-1517841040 None] Created volume successfully. Sep 25 17:03:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-71ae52a6-6b3a-4c85-b411-5ad1ba1fc408 tempest-VolumeQuotasAdminTestJSON-698787717 None] Transfer volume completed successfully. Sep 25 17:03:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Acquiring lock "cinder-84e286fc-b72f-4a97-a8bd-edcfd1b23caf-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:03:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Lock "cinder-84e286fc-b72f-4a97-a8bd-edcfd1b23caf-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:03:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Acquiring lock "cinder-quobyte-84e286fc-b72f-4a97-a8bd-edcfd1b23caf" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:03:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Lock "cinder-quobyte-84e286fc-b72f-4a97-a8bd-edcfd1b23caf" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:03:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8003a39-c14b-4522-b361-31a203bb617c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:03:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:50 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf Sep 25 17:03:50 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:51 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf" returned: 0 in 0.558s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:51 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf Sep 25 17:03:51 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:51 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-84e286fc-b72f-4a97-a8bd-edcfd1b23caf" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Lock "cinder-quobyte-84e286fc-b72f-4a97-a8bd-edcfd1b23caf" released by "delete_volume" :: held 1.179s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Created reservations ['95870643-b451-4722-bf13-8454c31595b1', 'ff1952d2-e441-4515-b382-0b6c7c86c7e9', '648529e3-dcf5-4575-a49b-34b7e2fc1768', '9999f58d-114b-4425-be57-fa34a308997a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:51 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:03:51 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:52 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:52 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:03:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Deleted volume successfully. Sep 25 17:03:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58c4c7b3-e875-4f51-8d3d-9d256ef2dbfd tempest-VolumeQuotasAdminTestJSON-1856766459 None] Lock "cinder-84e286fc-b72f-4a97-a8bd-edcfd1b23caf-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:03:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-a72c0541-a568-4586-8ac4-ac3cb9367739 req-8ca2685e-03e2-450f-9ec7-2fe9b59be20f tempest-ServerActionsTestOtherA-1752418897 None] Terminate volume connection completed successfully. Sep 25 17:03:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-a72c0541-a568-4586-8ac4-ac3cb9367739 req-8ca2685e-03e2-450f-9ec7-2fe9b59be20f tempest-ServerActionsTestOtherA-1752418897 None] Deleting attachment 0a2141ea-6728-47d3-a8bd-4ca148b8bc2d. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Flow 'volume_create_manager' (9ba56fac-2751-428a-8d32-b7922b760c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453970f1-b6f0-438b-9ec3-df510e3604af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453970f1-b6f0-438b-9ec3-df510e3604af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1626155262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd2fda8-befd-41f3-a946-e96ec9320ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bff7ec0269429a9c3288e83b762ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:53Z,use_quota=True,user_id='ce424c65f2734b3eaa2c411b10580904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca38d4c4-d676-41a3-a06c-a4d62ad35dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca38d4c4-d676-41a3-a06c-a4d62ad35dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362713bf-c407-476f-8732-e99836d4b43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362713bf-c407-476f-8732-e99836d4b43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd2fda8-befd-41f3-a946-e96ec9320ba7', 'volume_name': 'volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2cb4b7-23f3-4f92-8240-07f84aaacb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2cb4b7-23f3-4f92-8240-07f84aaacb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21bcc99-ba7c-4107-80c9-380bf8e18703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Volume dfd2fda8-befd-41f3-a946-e96ec9320ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7', 'volume_size': 1} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1626155262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd2fda8-befd-41f3-a946-e96ec9320ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bff7ec0269429a9c3288e83b762ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:03:53Z,use_quota=True,user_id='ce424c65f2734b3eaa2c411b10580904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Creating volume dfd2fda8-befd-41f3-a946-e96ec9320ba7 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:03:53 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:03:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:53 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 1073741824 Sep 25 17:03:53 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:54 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 1073741824" returned: 0 in 1.185s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:54 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 Sep 25 17:03:54 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:55 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7" returned: 0 in 0.426s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:03:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21bcc99-ba7c-4107-80c9-380bf8e18703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edefaab5-2370-41cf-93aa-2f5da1889d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:03:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Volume volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 (dfd2fda8-befd-41f3-a946-e96ec9320ba7): created successfully Sep 25 17:03:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edefaab5-2370-41cf-93aa-2f5da1889d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:03:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Flow 'volume_create_manager' (9ba56fac-2751-428a-8d32-b7922b760c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:03:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5ec7cc13-b9f7-4d98-ae22-e1c1f5b8e039 tempest-TaggedAttachmentsTest-99156396 None] Created volume successfully. Sep 25 17:03:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:03:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:03:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:03:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:03:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:03:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:03:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:03:56 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:03:56 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:03:56 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Sep 25 17:03:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:03:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:04:04 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:04:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Flow 'volume_create_manager' (5a33906e-b896-40ba-a864-f6cc6f42f573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e234cff7-0cd9-4df1-93fe-9a5a13b7292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e234cff7-0cd9-4df1-93fe-9a5a13b7292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1628654883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b987085-fe21-4e21-b04b-cb3bc7de509c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0872ca676a414c3ea838dd81de400d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:04Z,use_quota=True,user_id='f715c25b89664dcba82ffa294fac0efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbdd803-7c56-4169-ab1c-f8a1f0fb20f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbdd803-7c56-4169-ab1c-f8a1f0fb20f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded4dc2f-7bb1-4f3e-8099-b42df1c7d8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:04 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:04:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded4dc2f-7bb1-4f3e-8099-b42df1c7d8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b987085-fe21-4e21-b04b-cb3bc7de509c', 'volume_name': 'volume-6b987085-fe21-4e21-b04b-cb3bc7de509c', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d6fa5-a98f-457b-ba47-94966a249529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d6fa5-a98f-457b-ba47-94966a249529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c43f3e-ae33-41bb-bb64-355b87ec5266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:05 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Volume 6b987085-fe21-4e21-b04b-cb3bc7de509c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b987085-fe21-4e21-b04b-cb3bc7de509c', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:04:05 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Trying to clone 6b987085-fe21-4e21-b04b-cb3bc7de509c from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:04:06 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:04:06 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Image download 20.69 MB at 20.69 MB/s Sep 25 17:04:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f574af8-d654-4c1b-b3b0-76cc358fe68f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:06 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD Sep 25 17:04:06 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:07 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 is fetched for user f715c25b89664dcba82ffa294fac0efe. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b83b77-7b7d-451f-98a1-0b2956f11215]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:07 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD Sep 25 17:04:07 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:07 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD" returned: 0 in 0.605s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1628654883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b987085-fe21-4e21-b04b-cb3bc7de509c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0872ca676a414c3ea838dd81de400d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:04Z,use_quota=True,user_id='f715c25b89664dcba82ffa294fac0efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Creating volume 6b987085-fe21-4e21-b04b-cb3bc7de509c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:04:07 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:04:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:07 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c 1073741824 Sep 25 17:04:07 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:08 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c 1073741824" returned: 0 in 0.763s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:08 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c Sep 25 17:04:08 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Flow 'volume_create_manager' (3de23df2-b174-49d7-a9fa-354aed299187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf36d967-b3b4-42b9-8409-941cc1bfd7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf36d967-b3b4-42b9-8409-941cc1bfd7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1247729507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5a2b8c-68d5-4a81-a3cb-7227bba93c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c751e0ade94c189fe47a435b57bea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:09Z,use_quota=True,user_id='6a7839ea6eac4f939091f94cde846f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5feaa1-2a8e-4847-be5d-dce8c06c3791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5feaa1-2a8e-4847-be5d-dce8c06c3791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290d3b98-1f83-4784-b0ca-fed7517798dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290d3b98-1f83-4784-b0ca-fed7517798dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5a2b8c-68d5-4a81-a3cb-7227bba93c33', 'volume_name': 'volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be02b9e3-e690-4425-8d95-dac942251e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:09 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be02b9e3-e690-4425-8d95-dac942251e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2581b8-26e1-4e9d-9098-26a8b1887fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Volume 5c5a2b8c-68d5-4a81-a3cb-7227bba93c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33', 'volume_size': 1} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1247729507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5a2b8c-68d5-4a81-a3cb-7227bba93c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c751e0ade94c189fe47a435b57bea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:04:09Z,use_quota=True,user_id='6a7839ea6eac4f939091f94cde846f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Creating volume 5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:04:09 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:09 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 1073741824 Sep 25 17:04:09 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Attempting download of fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume 6b987085-fe21-4e21-b04b-cb3bc7de509c. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa60a802-b9a7-4f10-8721-edfdbc90fd91]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_9epm__jr {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:09 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_9epm__jr Sep 25 17:04:09 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:09 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_9epm__jr" returned: 0 in 0.450s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_9epm__jr {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:10 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 1073741824" returned: 0 in 0.817s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:10 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_9epm__jr Sep 25 17:04:10 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:10 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 Sep 25 17:04:10 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:10 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_9epm__jr" returned: 1 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_9epm__jr' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5410d9f-81d0-48f2-995b-74a3a3878f72]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:10 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:10 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD Sep 25 17:04:10 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a2581b8-26e1-4e9d-9098-26a8b1887fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b412f5d7-9986-4210-8082-1587af085d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Volume volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 (5c5a2b8c-68d5-4a81-a3cb-7227bba93c33): created successfully Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b412f5d7-9986-4210-8082-1587af085d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Flow 'volume_create_manager' (3de23df2-b174-49d7-a9fa-354aed299187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-356a48a9-67f3-4c63-8a98-96bd046ae4d3 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Created volume successfully. Sep 25 17:04:10 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] fe054675-e641-4e31-bdb5-5e70f8a00fc9 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:04:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:10 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c Sep 25 17:04:10 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Acquiring lock "cinder-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "cinder-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Acquiring lock "cinder-quobyte-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:04:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "cinder-quobyte-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:04:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad9956f-4127-4de3-ade8-d5559ec150a0]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:04:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:14 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 Sep 25 17:04:14 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:14 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c" returned: 0 in 3.759s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:14 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_q0rbn8fhdevstack@QuobyteHD, size 112.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:04:14 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Converted 112.00 MB image at 29.79 MB/s Sep 25 17:04:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:14 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33" returned: 0 in 0.795s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:14 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c 1G Sep 25 17:04:14 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:14 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33 Sep 25 17:04:14 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:15 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "cinder-quobyte-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33" released by "delete_volume" :: held 1.270s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Created reservations ['64d90226-1771-4ada-bdd5-e66815ebd75b', 'a82f5653-54ac-4c9e-b7f6-6b9287b837ff', '9141f536-006f-4dcb-96ca-b8eebe6ab243', 'a2469a05-6916-4b74-b69e-723a3e985b10'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:04:15 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c 1G" returned: 0 in 0.679s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Downloaded image fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume 6b987085-fe21-4e21-b04b-cb3bc7de509c successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 for user f715c25b89664dcba82ffa294fac0efe is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Marking volume 6b987085-fe21-4e21-b04b-cb3bc7de509c as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Copying metadata from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 to 6b987085-fe21-4e21-b04b-cb3bc7de509c. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Creating volume glance metadata for volume 6b987085-fe21-4e21-b04b-cb3bc7de509c backed by image fe054675-e641-4e31-bdb5-5e70f8a00fc9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:15 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:04:15 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c43f3e-ae33-41bb-bb64-355b87ec5266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b987085-fe21-4e21-b04b-cb3bc7de509c', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865f48cf-8b40-4964-b5b8-1f697bcee947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:04:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Volume volume-6b987085-fe21-4e21-b04b-cb3bc7de509c (6b987085-fe21-4e21-b04b-cb3bc7de509c): created successfully Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865f48cf-8b40-4964-b5b8-1f697bcee947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:04:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Flow 'volume_create_manager' (5a33906e-b896-40ba-a864-f6cc6f42f573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:04:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-87ff98a0-a442-4150-838a-e116659067b6 tempest-ServerActionsTestOtherA-1752418897 None] Created volume successfully. Sep 25 17:04:16 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.763s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:16 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:04:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Deleted volume successfully. Sep 25 17:04:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bbf47e76-8f1e-404d-b679-d37b58a724d0 tempest-VolumeQuotasNegativeTestJSON-733100912 None] Lock "cinder-5c5a2b8c-68d5-4a81-a3cb-7227bba93c33-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:04:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-11d74002-be12-4fb2-9297-a4eae3fafc65 req-c6324e72-c592-4135-81cc-bb5afd428872 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-11d74002-be12-4fb2-9297-a4eae3fafc65 req-c6324e72-c592-4135-81cc-bb5afd428872 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-11d74002-be12-4fb2-9297-a4eae3fafc65 req-c6324e72-c592-4135-81cc-bb5afd428872 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-11d74002-be12-4fb2-9297-a4eae3fafc65 req-c6324e72-c592-4135-81cc-bb5afd428872 tempest-ServerActionsTestOtherA-1752418897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-6b987085-fe21-4e21-b04b-cb3bc7de509c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05dabfd9-1608-4901-9b37-35114e40a0f5', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:04:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-11d74002-be12-4fb2-9297-a4eae3fafc65 req-c6324e72-c592-4135-81cc-bb5afd428872 tempest-ServerActionsTestOtherA-1752418897 None] attachment_update completed successfully. Sep 25 17:04:35 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=43,cinder:INSERT=19,cinder:UPDATE=46,cinder:DELETE=5 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:04:35 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=55,cinder:SELECT=49,cinder:DELETE=4,cinder:INSERT=15 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:04:56 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:04:56 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:04:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-79368189-3613-4fdd-8b2f-2dd3965b4c9e req-ab090edd-5179-4e03-ae72-1f19b66e3d61 tempest-ServerActionsTestOtherA-1752418897 None] Terminate volume connection completed successfully. Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-79368189-3613-4fdd-8b2f-2dd3965b4c9e req-ab090edd-5179-4e03-ae72-1f19b66e3d61 tempest-ServerActionsTestOtherA-1752418897 None] Deleting attachment 05dabfd9-1608-4901-9b37-35114e40a0f5. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:04:56 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.721s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:04:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:04:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-baa374fb-cbe0-4f40-959f-fc9edd8673e6 req-3719ab91-5651-437f-a0c0-39c6dbbb6042 tempest-TaggedAttachmentsTest-99156396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:04:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-baa374fb-cbe0-4f40-959f-fc9edd8673e6 req-3719ab91-5651-437f-a0c0-39c6dbbb6042 tempest-TaggedAttachmentsTest-99156396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:04:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-baa374fb-cbe0-4f40-959f-fc9edd8673e6 req-3719ab91-5651-437f-a0c0-39c6dbbb6042 tempest-TaggedAttachmentsTest-99156396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:04:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-baa374fb-cbe0-4f40-959f-fc9edd8673e6 req-3719ab91-5651-437f-a0c0-39c6dbbb6042 tempest-TaggedAttachmentsTest-99156396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efbf5a63-12ee-4213-9d17-bb9a6d77b7b4', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:04:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-baa374fb-cbe0-4f40-959f-fc9edd8673e6 req-3719ab91-5651-437f-a0c0-39c6dbbb6042 tempest-TaggedAttachmentsTest-99156396 None] attachment_update completed successfully. Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-79368189-3613-4fdd-8b2f-2dd3965b4c9e req-cb20a93a-8d80-428c-9777-4aa4a1d03fb4 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-79368189-3613-4fdd-8b2f-2dd3965b4c9e req-cb20a93a-8d80-428c-9777-4aa4a1d03fb4 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-79368189-3613-4fdd-8b2f-2dd3965b4c9e req-cb20a93a-8d80-428c-9777-4aa4a1d03fb4 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-79368189-3613-4fdd-8b2f-2dd3965b4c9e req-cb20a93a-8d80-428c-9777-4aa4a1d03fb4 tempest-ServerActionsTestOtherA-1752418897 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-6b987085-fe21-4e21-b04b-cb3bc7de509c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e42e5db2-e66b-4729-bc14-4a2da815b95c', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Flow 'volume_create_manager' (2ad766ad-26e1-40d3-86bd-e1078f40c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b0d216-9e4e-494e-962a-cc939001bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b0d216-9e4e-494e-962a-cc939001bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1197445182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c761c9-38c9-4395-98fa-5620a4ea72f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9dda8604e84169b3699a41e92d078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:01Z,use_quota=True,user_id='887a5d4d61784bafb9736863af830ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e6fa7b-b07c-4f0f-962c-603494f34fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e6fa7b-b07c-4f0f-962c-603494f34fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6170332-20d1-492f-b3b8-7b6f070a72c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6170332-20d1-492f-b3b8-7b6f070a72c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c761c9-38c9-4395-98fa-5620a4ea72f0', 'volume_name': 'volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac44942-672f-4481-b01f-9f9a73ab7251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac44942-672f-4481-b01f-9f9a73ab7251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f1e639-7b43-471f-ad51-6b9750c1689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Volume a0c761c9-38c9-4395-98fa-5620a4ea72f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0', 'volume_size': 1} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1197445182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c761c9-38c9-4395-98fa-5620a4ea72f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9dda8604e84169b3699a41e92d078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:01Z,use_quota=True,user_id='887a5d4d61784bafb9736863af830ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Creating volume a0c761c9-38c9-4395-98fa-5620a4ea72f0 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:05:01 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:05:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-79368189-3613-4fdd-8b2f-2dd3965b4c9e req-cb20a93a-8d80-428c-9777-4aa4a1d03fb4 tempest-ServerActionsTestOtherA-1752418897 None] attachment_update completed successfully. Sep 25 17:05:01 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 1073741824 Sep 25 17:05:01 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:02 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 1073741824" returned: 0 in 1.041s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:02 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 Sep 25 17:05:02 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:03 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:05:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f1e639-7b43-471f-ad51-6b9750c1689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b89987-f1c0-4164-a736-a474258c5a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Volume volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 (a0c761c9-38c9-4395-98fa-5620a4ea72f0): created successfully Sep 25 17:05:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b89987-f1c0-4164-a736-a474258c5a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Flow 'volume_create_manager' (2ad766ad-26e1-40d3-86bd-e1078f40c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-39184437-0ef1-4c32-b029-049fda0c1bc7 tempest-VolumesTransfersV355Test-1486487556 None] Created volume successfully. Sep 25 17:05:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-f5d9c3b5-be8c-44de-92d3-3424a8009620 req-c8e75bf0-a2f9-4356-ad73-cdbbe1e3eb56 tempest-TaggedAttachmentsTest-99156396 None] Terminate volume connection completed successfully. Sep 25 17:05:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-f5d9c3b5-be8c-44de-92d3-3424a8009620 req-c8e75bf0-a2f9-4356-ad73-cdbbe1e3eb56 tempest-TaggedAttachmentsTest-99156396 None] Deleting attachment efbf5a63-12ee-4213-9d17-bb9a6d77b7b4. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:05:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4da7aa79-1fdd-4b74-b8ec-89142321017a tempest-VolumesTransfersV355Test-747677207 None] Transfer volume completed successfully. Sep 25 17:05:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Acquiring lock "cinder-a0c761c9-38c9-4395-98fa-5620a4ea72f0-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Lock "cinder-a0c761c9-38c9-4395-98fa-5620a4ea72f0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Acquiring lock "cinder-quobyte-a0c761c9-38c9-4395-98fa-5620a4ea72f0" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Lock "cinder-quobyte-a0c761c9-38c9-4395-98fa-5620a4ea72f0" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9db365-084e-43dc-9ce8-b922b7007c25]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:05:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:08 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 Sep 25 17:05:08 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:08 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0" returned: 0 in 0.596s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:08 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0 Sep 25 17:05:08 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:09 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a0c761c9-38c9-4395-98fa-5620a4ea72f0" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Lock "cinder-quobyte-a0c761c9-38c9-4395-98fa-5620a4ea72f0" released by "delete_volume" :: held 1.031s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Created reservations ['c061f3f4-59fe-4257-97ea-68649f9eb9de', '0b0b9f54-9917-49d7-86de-d13548535133', '05167d34-bd15-4ff3-b9db-728050549d96', '276c21ab-7e51-47f1-aba2-07aad6c01ac0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:09 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:05:09 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:09 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:05:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Deleted volume successfully. Sep 25 17:05:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dcd752d8-b363-474f-9f52-cd9a72b13ce7 tempest-VolumesTransfersV355Test-1312238175 None] Lock "cinder-a0c761c9-38c9-4395-98fa-5620a4ea72f0-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Flow 'volume_create_manager' (1ca7b463-4e0f-4e7d-9266-52c2feb3d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf8ed37-6a42-4d5b-8976-a0627fd1174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf8ed37-6a42-4d5b-8976-a0627fd1174e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1948217992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49465577-eab2-47ad-abbf-04c31d711a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9dda8604e84169b3699a41e92d078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:12Z,use_quota=True,user_id='887a5d4d61784bafb9736863af830ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc49870-323a-4be7-a0ba-b5d8da11ce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc49870-323a-4be7-a0ba-b5d8da11ce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a511bd-c212-4ca1-b129-6fd666f19dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a511bd-c212-4ca1-b129-6fd666f19dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49465577-eab2-47ad-abbf-04c31d711a13', 'volume_name': 'volume-49465577-eab2-47ad-abbf-04c31d711a13', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fa9078-2168-4d99-84f0-d5ef863007e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fa9078-2168-4d99-84f0-d5ef863007e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2940a026-63c3-4489-b957-b8603f081a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Volume 49465577-eab2-47ad-abbf-04c31d711a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49465577-eab2-47ad-abbf-04c31d711a13', 'volume_size': 1} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1948217992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49465577-eab2-47ad-abbf-04c31d711a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9dda8604e84169b3699a41e92d078e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:12Z,use_quota=True,user_id='887a5d4d61784bafb9736863af830ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Creating volume 49465577-eab2-47ad-abbf-04c31d711a13 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:05:11 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:05:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:12 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13 1073741824 Sep 25 17:05:12 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:12 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13 1073741824" returned: 0 in 0.987s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:13 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13 Sep 25 17:05:13 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:13 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13" returned: 0 in 0.540s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:05:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2940a026-63c3-4489-b957-b8603f081a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49465577-eab2-47ad-abbf-04c31d711a13', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae1e8da-c5ba-43fb-b4a2-995e0c153721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Volume volume-49465577-eab2-47ad-abbf-04c31d711a13 (49465577-eab2-47ad-abbf-04c31d711a13): created successfully Sep 25 17:05:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae1e8da-c5ba-43fb-b4a2-995e0c153721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Flow 'volume_create_manager' (1ca7b463-4e0f-4e7d-9266-52c2feb3d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8d075a0b-d9d2-4d83-ba78-15799116dde4 tempest-VolumesTransfersV355Test-1486487556 None] Created volume successfully. Sep 25 17:05:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Acquiring lock "cinder-49465577-eab2-47ad-abbf-04c31d711a13-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Lock "cinder-49465577-eab2-47ad-abbf-04c31d711a13-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Acquiring lock "cinder-quobyte-49465577-eab2-47ad-abbf-04c31d711a13" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Lock "cinder-quobyte-49465577-eab2-47ad-abbf-04c31d711a13" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96af10c-3fba-4526-ade5-7640f4dfc441]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:05:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:16 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13 Sep 25 17:05:16 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:16 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13" returned: 0 in 0.781s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:16 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13 Sep 25 17:05:16 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:17 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-49465577-eab2-47ad-abbf-04c31d711a13" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Lock "cinder-quobyte-49465577-eab2-47ad-abbf-04c31d711a13" released by "delete_volume" :: held 1.289s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Created reservations ['bd4e7f6e-2ef0-41df-a859-165c0ca467d3', 'a446b799-02f0-4597-b22d-a109a22551e4', '294889f0-f7a5-4d94-9780-c6d96ea32287', '01dd2394-3e03-40a1-a2d4-72631f7c4b88'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:17 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:05:17 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:17 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:05:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Deleted volume successfully. Sep 25 17:05:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6747b141-7992-4f93-a2eb-142064ead547 tempest-VolumesTransfersV355Test-1312238175 None] Lock "cinder-49465577-eab2-47ad-abbf-04c31d711a13-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Acquiring lock "cinder-dfd2fda8-befd-41f3-a946-e96ec9320ba7-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Lock "cinder-dfd2fda8-befd-41f3-a946-e96ec9320ba7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Acquiring lock "cinder-quobyte-dfd2fda8-befd-41f3-a946-e96ec9320ba7" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Lock "cinder-quobyte-dfd2fda8-befd-41f3-a946-e96ec9320ba7" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c235c44f-ef0f-4568-bc5a-139aa57e9aaa]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:05:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:21 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 Sep 25 17:05:21 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:21 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:05:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Flow 'volume_create_manager' (5b71f11b-5ed6-4a5a-8377-82fe22450f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054fe3ee-e2b7-4625-881c-bd325529a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054fe3ee-e2b7-4625-881c-bd325529a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1131931085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e676b30-c195-4593-9699-574b527d50d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8940b778e734c7eb827fe795669154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:22Z,use_quota=True,user_id='5af258aec1614080bf44d01fe8f24f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7aee95b-5a22-41b5-9810-613ea5a71bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7aee95b-5a22-41b5-9810-613ea5a71bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d875e7d1-061f-4210-93ab-f0d18be2eb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d875e7d1-061f-4210-93ab-f0d18be2eb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e676b30-c195-4593-9699-574b527d50d5', 'volume_name': 'volume-0e676b30-c195-4593-9699-574b527d50d5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421aef94-d1d2-42b2-924f-486f978312f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421aef94-d1d2-42b2-924f-486f978312f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f578f6f-970a-4817-b998-35e22e7d21ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Volume 0e676b30-c195-4593-9699-574b527d50d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e676b30-c195-4593-9699-574b527d50d5', 'volume_size': 1} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1131931085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e676b30-c195-4593-9699-574b527d50d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8940b778e734c7eb827fe795669154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:22Z,use_quota=True,user_id='5af258aec1614080bf44d01fe8f24f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Creating volume 0e676b30-c195-4593-9699-574b527d50d5 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:05:22 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:22 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5 1073741824 Sep 25 17:05:22 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:22 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7" returned: 0 in 0.695s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:22 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7 Sep 25 17:05:22 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:22 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5 1073741824" returned: 0 in 0.719s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:22 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5 Sep 25 17:05:22 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:22 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dfd2fda8-befd-41f3-a946-e96ec9320ba7" returned: 0 in 0.479s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Lock "cinder-quobyte-dfd2fda8-befd-41f3-a946-e96ec9320ba7" released by "delete_volume" :: held 1.244s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Created reservations ['796b168e-2758-4518-a9cf-070b15d9cb9f', '6516ff6b-8675-4f06-8e05-6368f07b50c3', '4802de22-a6cc-4264-a6f8-1520c708f646', '938c6f3e-08c9-4190-b559-3ab95d0846d5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:23 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:05:23 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:23 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5" returned: 0 in 0.472s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f578f6f-970a-4817-b998-35e22e7d21ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e676b30-c195-4593-9699-574b527d50d5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed529e9-4905-444a-908a-aaa113c0382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Volume volume-0e676b30-c195-4593-9699-574b527d50d5 (0e676b30-c195-4593-9699-574b527d50d5): created successfully Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed529e9-4905-444a-908a-aaa113c0382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Flow 'volume_create_manager' (5b71f11b-5ed6-4a5a-8377-82fe22450f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ae480c7a-ec19-45ba-91d5-697edd948f21 tempest-AttachVolumeShelveTestJSON-1471054968 None] Created volume successfully. Sep 25 17:05:23 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:05:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Deleted volume successfully. Sep 25 17:05:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-20a9ffd8-6a5a-493d-b068-478b9c7ab0ee tempest-TaggedAttachmentsTest-99156396 None] Lock "cinder-dfd2fda8-befd-41f3-a946-e96ec9320ba7-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:33 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=36,cinder:UPDATE=40,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:05:33 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=37,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:05:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-bf16f0ed-904a-47e7-8b49-d180dc95d775 req-bbf72cca-342d-49d2-a95b-00a6ac1b5bab tempest-AttachVolumeShelveTestJSON-1471054968 None] No connector for attachment a69f2afe-6400-435e-9a43-2583580f3fba; skipping storage backend terminate_connection call. {{(pid=87232) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 17:05:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-bf16f0ed-904a-47e7-8b49-d180dc95d775 req-bbf72cca-342d-49d2-a95b-00a6ac1b5bab tempest-AttachVolumeShelveTestJSON-1471054968 None] Deleting attachment a69f2afe-6400-435e-9a43-2583580f3fba. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:05:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-a22ab1dc-2197-4e1c-ac4f-71b491a7bb68 tempest-ServerActionsTestOtherA-1752418897 None] Terminate volume connection completed successfully. Sep 25 17:05:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-a22ab1dc-2197-4e1c-ac4f-71b491a7bb68 tempest-ServerActionsTestOtherA-1752418897 None] Deleting attachment e42e5db2-e66b-4729-bc14-4a2da815b95c. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:05:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "cinder-6b987085-fe21-4e21-b04b-cb3bc7de509c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Lock "cinder-6b987085-fe21-4e21-b04b-cb3bc7de509c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "cinder-quobyte-6b987085-fe21-4e21-b04b-cb3bc7de509c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Lock "cinder-quobyte-6b987085-fe21-4e21-b04b-cb3bc7de509c" acquired by "delete_volume" :: waited 0.045s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcf3769-74fe-4131-8aff-efb9112581c3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:05:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:44 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c Sep 25 17:05:44 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:44 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c" returned: 0 in 0.658s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:44 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c Sep 25 17:05:44 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "cinder-7e266f3d-380f-4206-a6c7-4dd3b1861a67-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Lock "cinder-7e266f3d-380f-4206-a6c7-4dd3b1861a67-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "cinder-quobyte-7e266f3d-380f-4206-a6c7-4dd3b1861a67" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Lock "cinder-quobyte-7e266f3d-380f-4206-a6c7-4dd3b1861a67" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[46daebf8-25dd-4881-b633-375337fd5fdc]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:45 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6b987085-fe21-4e21-b04b-cb3bc7de509c" returned: 0 in 0.548s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Lock "cinder-quobyte-6b987085-fe21-4e21-b04b-cb3bc7de509c" released by "delete_volume" :: held 1.291s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:45 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 Sep 25 17:05:45 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG cinder.quota [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Created reservations ['8edf6187-7789-4f47-9d3f-0b9d085de3a6', '15d98520-e162-41fe-a384-372dcac97eec', 'd9e0a7c4-eb89-49ac-87af-b985a8cd613b', 'd703b6c3-97b3-40d3-b1bc-58b5f54bf0d9'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:45 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:05:45 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:45 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67" returned: 0 in 0.665s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:45 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67 Sep 25 17:05:45 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:46 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG cinder.manager [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:05:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Deleted volume successfully. Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-33ed6457-2527-4ef9-b41a-3ba697f9610c req-db3fd100-ef36-4c41-adcc-d6551dba7b64 tempest-ServerActionsTestOtherA-1752418897 None] Lock "cinder-6b987085-fe21-4e21-b04b-cb3bc7de509c-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:46 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e266f3d-380f-4206-a6c7-4dd3b1861a67" returned: 0 in 0.478s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Lock "cinder-quobyte-7e266f3d-380f-4206-a6c7-4dd3b1861a67" released by "delete_volume" :: held 1.271s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Created reservations ['d4e90d6b-4e37-4d97-9698-5c0b22ca1cca', 'ce6b18b0-4fb2-4753-b0f6-06a507c9c183', '8859e526-5426-4545-b607-3829257ed479', 'a4b2391b-0eaa-4d75-ac33-b9a1e59063d4'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:46 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:05:46 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:47 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:47 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:05:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Deleted volume successfully. Sep 25 17:05:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d88fab6-bcd6-4af2-81c3-8de8cb51ce50 tempest-ServerActionsTestOtherA-1752418897 None] Lock "cinder-7e266f3d-380f-4206-a6c7-4dd3b1861a67-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Flow 'volume_create_manager' (f1e82f5d-3ba9-4f88-bb43-27636d0e1bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d73098e-9819-4c51-a95a-ecd05e72f575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d73098e-9819-4c51-a95a-ecd05e72f575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406778495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9a82a9-13e0-4a07-9ff3-86de44f884dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435f56c466f548d6bad6c9ad88bd9d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:49Z,use_quota=True,user_id='fc5fb607e5b04443bb0a1f344f2ad5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4cc86c-525e-460e-896a-30eb3a115303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4cc86c-525e-460e-896a-30eb3a115303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541d52d7-ead2-41cf-8e20-c9cba84f9799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541d52d7-ead2-41cf-8e20-c9cba84f9799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9a82a9-13e0-4a07-9ff3-86de44f884dd', 'volume_name': 'volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70aa285-09ea-4671-a496-e56be375f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70aa285-09ea-4671-a496-e56be375f50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca0c266-caaa-4768-8f03-39dd07e483f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Volume bd9a82a9-13e0-4a07-9ff3-86de44f884dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd', 'volume_size': 1} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406778495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9a82a9-13e0-4a07-9ff3-86de44f884dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='435f56c466f548d6bad6c9ad88bd9d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:05:49Z,use_quota=True,user_id='fc5fb607e5b04443bb0a1f344f2ad5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Creating volume bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:05:48 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:05:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:48 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd 1073741824 Sep 25 17:05:48 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:49 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd 1073741824" returned: 0 in 0.691s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:49 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd Sep 25 17:05:49 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:50 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:05:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca0c266-caaa-4768-8f03-39dd07e483f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82d655e-6eec-4b92-96a4-31cd3c733f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:05:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Volume volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd (bd9a82a9-13e0-4a07-9ff3-86de44f884dd): created successfully Sep 25 17:05:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82d655e-6eec-4b92-96a4-31cd3c733f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:05:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Flow 'volume_create_manager' (f1e82f5d-3ba9-4f88-bb43-27636d0e1bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:05:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6fc0c317-2f01-4643-bfb4-e352a82753a7 tempest-VolumesActionsTest-1438174996 None] Created volume successfully. Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:05:56 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:05:56 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:05:56 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:05:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:06:00 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=14,cinder:UPDATE=22,cinder:INSERT=5 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:06:00 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=14,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:06:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d2a8a664-e683-4ebb-8820-44e888812059 tempest-VolumesActionsTest-1438174996 None] Acquiring lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" by "attach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d2a8a664-e683-4ebb-8820-44e888812059 tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" acquired by "attach_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d2a8a664-e683-4ebb-8820-44e888812059 tempest-VolumesActionsTest-1438174996 None] Attaching volume bd9a82a9-13e0-4a07-9ff3-86de44f884dd to instance f3100cbc-4d4d-4894-96a6-12aee081c8b2 at mountpoint /dev/vdb on host None. Sep 25 17:06:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d2a8a664-e683-4ebb-8820-44e888812059 tempest-VolumesActionsTest-1438174996 None] Attach volume completed successfully. Sep 25 17:06:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d2a8a664-e683-4ebb-8820-44e888812059 tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" released by "attach_volume" :: held 0.173s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c70b5f29-6e88-4cc4-a48d-2f63c45ec73c tempest-VolumesActionsTest-1438174996 None] Acquiring lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd-detach_volume" by "detach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c70b5f29-6e88-4cc4-a48d-2f63c45ec73c tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c70b5f29-6e88-4cc4-a48d-2f63c45ec73c tempest-VolumesActionsTest-1438174996 None] Detaching volume bd9a82a9-13e0-4a07-9ff3-86de44f884dd from instance f3100cbc-4d4d-4894-96a6-12aee081c8b2. Sep 25 17:06:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c70b5f29-6e88-4cc4-a48d-2f63c45ec73c tempest-VolumesActionsTest-1438174996 None] Detach volume completed successfully. Sep 25 17:06:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c70b5f29-6e88-4cc4-a48d-2f63c45ec73c tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd-detach_volume" released by "detach_volume" :: held 0.241s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:06:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:06:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0d291c75-588a-43cf-a5ae-18e8abe30b8d tempest-VolumesActionsTest-1438174996 None] Acquiring lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" by "attach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0d291c75-588a-43cf-a5ae-18e8abe30b8d tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" acquired by "attach_volume" :: waited 0.066s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0d291c75-588a-43cf-a5ae-18e8abe30b8d tempest-VolumesActionsTest-1438174996 None] Attaching volume bd9a82a9-13e0-4a07-9ff3-86de44f884dd to instance 932a7b70-c212-4d5d-8288-5185eebd3b4f at mountpoint /dev/vdb on host None. Sep 25 17:06:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0d291c75-588a-43cf-a5ae-18e8abe30b8d tempest-VolumesActionsTest-1438174996 None] Attach volume completed successfully. Sep 25 17:06:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0d291c75-588a-43cf-a5ae-18e8abe30b8d tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" released by "attach_volume" :: held 0.229s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22002f10-1c2b-4e5a-90c5-45031fd76099 tempest-VolumesActionsTest-1438174996 None] Acquiring lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd-detach_volume" by "detach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22002f10-1c2b-4e5a-90c5-45031fd76099 tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-22002f10-1c2b-4e5a-90c5-45031fd76099 tempest-VolumesActionsTest-1438174996 None] Detaching volume bd9a82a9-13e0-4a07-9ff3-86de44f884dd from instance 932a7b70-c212-4d5d-8288-5185eebd3b4f. Sep 25 17:06:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-22002f10-1c2b-4e5a-90c5-45031fd76099 tempest-VolumesActionsTest-1438174996 None] Detach volume completed successfully. Sep 25 17:06:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22002f10-1c2b-4e5a-90c5-45031fd76099 tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Acquiring lock "cinder-0e676b30-c195-4593-9699-574b527d50d5-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "cinder-0e676b30-c195-4593-9699-574b527d50d5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Acquiring lock "cinder-quobyte-0e676b30-c195-4593-9699-574b527d50d5" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:06:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "cinder-quobyte-0e676b30-c195-4593-9699-574b527d50d5" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:06:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[11acb851-0fd7-4b39-9f60-6a0a9c09d95d]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:51 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5 Sep 25 17:06:51 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:52 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5" returned: 0 in 0.971s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:52 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5 Sep 25 17:06:52 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:52 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0e676b30-c195-4593-9699-574b527d50d5" returned: 0 in 0.490s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "cinder-quobyte-0e676b30-c195-4593-9699-574b527d50d5" released by "delete_volume" :: held 1.537s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Created reservations ['2e109056-9757-4430-8168-3a7c5270aa82', 'fb5cd48e-6834-4d7d-a2e9-1e8f2ff82723', 'b3ac5bec-1382-4099-8c36-ab59793ca9f7', '39b5d414-80c2-4e2a-bf4d-d3373c04a2c3'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:52 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:06:52 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:53 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.410s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:53 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Deleted volume successfully. Sep 25 17:06:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-71dc18b2-1b1a-4ba6-9010-0205382508c6 tempest-AttachVolumeShelveTestJSON-1471054968 None] Lock "cinder-0e676b30-c195-4593-9699-574b527d50d5-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:06:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9850f6dc-da5e-49d6-aa01-2b0c152283b4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:54 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd Sep 25 17:06:54 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:54 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" returned: 0 in 0.513s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f73aa4-2282-4216-a00b-b9381fb28713]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:06:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:54 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd Sep 25 17:06:54 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:55 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" returned: 0 in 0.773s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.81ccce23-f9de-45ea-9a07-e60e24d7e0f8ha8fylpl.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:55 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.81ccce23-f9de-45ea-9a07-e60e24d7e0f8ha8fylpl.img Sep 25 17:06:55 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:06:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:06:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:06:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:06:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:06:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:06:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:06:56 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:06:56 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:06:57 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 1.006s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Flow 'volume_create_manager' (ae653008-96b0-47b7-bc58-bc196a4e95de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544fc9d1-eee0-446a-87ec-8782c1273275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544fc9d1-eee0-446a-87ec-8782c1273275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-410862465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182518a7-ae53-4953-ac69-dc62e05540f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da94cc69479c408ca6e2ec80ad2e813a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:57Z,use_quota=True,user_id='1634b50dd6b0418aadb5170a21ef0726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b691c29-56fb-49c9-a6ff-7a9221705144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b691c29-56fb-49c9-a6ff-7a9221705144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b417a32-eb5f-481c-906a-3970565d3050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b417a32-eb5f-481c-906a-3970565d3050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182518a7-ae53-4953-ac69-dc62e05540f1', 'volume_name': 'volume-182518a7-ae53-4953-ac69-dc62e05540f1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22ce0f7-a9d5-4926-9196-0441923e41dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22ce0f7-a9d5-4926-9196-0441923e41dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7162e192-2af9-46a4-834b-429790c3e1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:06:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Volume 182518a7-ae53-4953-ac69-dc62e05540f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182518a7-ae53-4953-ac69-dc62e05540f1', 'volume_size': 1} Sep 25 17:06:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:07 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.81ccce23-f9de-45ea-9a07-e60e24d7e0f8ha8fylpl.img" returned: 0 in 11.736s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d77cd3c-c9d2-45cf-9bbc-4c1aab5c24de]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:07 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd Sep 25 17:07:07 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:07 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:INSERT=2,cinder:SELECT=14,cinder:UPDATE=12 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:07:07 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:07:07 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" returned: 0 in 0.850s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:07 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd, size 1024.00 MB, duration 11.74 sec, destination /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.81ccce23-f9de-45ea-9a07-e60e24d7e0f8ha8fylpl.img {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:07:07 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Converted 1024.00 MB image at 87.24 MB/s Sep 25 17:07:07 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] 81ccce23-f9de-45ea-9a07-e60e24d7e0f8 was raw, no need to convert to raw {{(pid=87232) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Flow 'volume_create_manager' (91a5c8a1-b448-4895-95a2-6ce2e54a9bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11043bec-4edc-4fe6-9c23-c2a868f3e6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11043bec-4edc-4fe6-9c23-c2a868f3e6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1826732910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2201d017-b851-4ab3-9491-c51207c4adc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458d28da28eb495a89d4cd872468fe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:17Z,use_quota=True,user_id='3a8ddbf217f1471d95cdf27719016a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3ec8a1-16ab-4c2a-be7e-a21e3aa288b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3ec8a1-16ab-4c2a-be7e-a21e3aa288b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8928451c-fc2e-4fa4-981f-fec38317ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8928451c-fc2e-4fa4-981f-fec38317ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2201d017-b851-4ab3-9491-c51207c4adc8', 'volume_name': 'volume-2201d017-b851-4ab3-9491-c51207c4adc8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587d1f24-d316-410e-98c0-78d795fd8891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587d1f24-d316-410e-98c0-78d795fd8891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f33b5e1-fc9d-4256-91ef-ede7a6cb218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Volume 2201d017-b851-4ab3-9491-c51207c4adc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2201d017-b851-4ab3-9491-c51207c4adc8', 'volume_size': 1} Sep 25 17:07:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:27 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:07:27 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.197s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Uploaded volume to glance image-id: 81ccce23-f9de-45ea-9a07-e60e24d7e0f8. {{(pid=87232) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 37.232s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-410862465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182518a7-ae53-4953-ac69-dc62e05540f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da94cc69479c408ca6e2ec80ad2e813a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:06:57Z,use_quota=True,user_id='1634b50dd6b0418aadb5170a21ef0726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Creating volume 182518a7-ae53-4953-ac69-dc62e05540f1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:07:35 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:35 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1 1073741824 Sep 25 17:07:35 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-05ba4256-3d65-432e-988a-e8e8adc795d7 tempest-VolumesActionsTest-1438174996 None] Copy volume to image completed successfully. Sep 25 17:07:35 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1 1073741824" returned: 0 in 0.748s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:36 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1 Sep 25 17:07:36 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:36 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1" returned: 0 in 0.556s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.204s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1826732910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2201d017-b851-4ab3-9491-c51207c4adc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458d28da28eb495a89d4cd872468fe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:17Z,use_quota=True,user_id='3a8ddbf217f1471d95cdf27719016a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Creating volume 2201d017-b851-4ab3-9491-c51207c4adc8 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:07:36 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7162e192-2af9-46a4-834b-429790c3e1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182518a7-ae53-4953-ac69-dc62e05540f1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49b3f7c-6350-4859-8155-d340400e9afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:36 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8 1073741824 Sep 25 17:07:36 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Volume volume-182518a7-ae53-4953-ac69-dc62e05540f1 (182518a7-ae53-4953-ac69-dc62e05540f1): created successfully Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49b3f7c-6350-4859-8155-d340400e9afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Flow 'volume_create_manager' (ae653008-96b0-47b7-bc58-bc196a4e95de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ce48f174-fad3-4dce-9667-64cdd854f215 tempest-AttachVolumeNegativeTest-2013442506 None] Created volume successfully. Sep 25 17:07:37 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8 1073741824" returned: 0 in 0.783s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:37 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8 Sep 25 17:07:37 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:37 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8" returned: 0 in 0.429s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f33b5e1-fc9d-4256-91ef-ede7a6cb218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2201d017-b851-4ab3-9491-c51207c4adc8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93792560-6741-4d37-9b63-2d14152cdbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Volume volume-2201d017-b851-4ab3-9491-c51207c4adc8 (2201d017-b851-4ab3-9491-c51207c4adc8): created successfully Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93792560-6741-4d37-9b63-2d14152cdbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Flow 'volume_create_manager' (91a5c8a1-b448-4895-95a2-6ce2e54a9bd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7ee1adf2-5a49-410f-8b56-b9a181fb0ad0 tempest-ServersNegativeTestJSON-2137897301 None] Created volume successfully. Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8c1a8-a167-4f8a-924c-19148d5e720a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:38 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd Sep 25 17:07:38 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:38 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" returned: 0 in 0.617s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef953dd0-3699-4119-b1d2-81265ee6c6a5]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-f067b3f4-a942-43fa-848f-9bf6d90bbecd req-2181bfbb-a0f2-46df-913d-5468dac489a9 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:38 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd Sep 25 17:07:38 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:39 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" returned: 0 in 0.595s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:39 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img Sep 25 17:07:39 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Flow 'volume_create_manager' (08a18b1f-bc1f-46ad-a0fa-5db39d587123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a950b6-aeb0-476a-8136-1d3b744f136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a950b6-aeb0-476a-8136-1d3b744f136e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1946761131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af71ab94-afdf-436b-841f-a4838f9d29a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458d28da28eb495a89d4cd872468fe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:41Z,use_quota=True,user_id='3a8ddbf217f1471d95cdf27719016a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c732fd6-e646-445f-bad9-dc21264c88a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c732fd6-e646-445f-bad9-dc21264c88a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd92bf8a-a896-431e-836d-fdb12d7800c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd92bf8a-a896-431e-836d-fdb12d7800c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af71ab94-afdf-436b-841f-a4838f9d29a6', 'volume_name': 'volume-af71ab94-afdf-436b-841f-a4838f9d29a6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f95cad1-8892-4e66-883f-56d65143823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f95cad1-8892-4e66-883f-56d65143823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4923922a-ae13-4eab-9c0f-80f72f7008f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Volume af71ab94-afdf-436b-841f-a4838f9d29a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af71ab94-afdf-436b-841f-a4838f9d29a6', 'volume_size': 1} Sep 25 17:07:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:50 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img" returned: 0 in 11.032s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[185d2245-0c51-4c40-8bc6-cdccd6d3c760]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:50 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd Sep 25 17:07:50 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=3,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:07:50 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" returned: 0 in 0.636s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd, size 1024.00 MB, duration 11.03 sec, destination /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:07:50 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Converted 1024.00 MB image at 92.81 MB/s Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] c9380cee-1a24-4f0a-81ea-55849bfa7029 was raw, converting to qcow2 {{(pid=87232) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc6a95-96a5-4631-9cbf-29edaad47fa8]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:51 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img Sep 25 17:07:51 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:51 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:51 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img Sep 25 17:07:51 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:51 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img" returned: 1 in 0.408s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:07:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img /opt/stack/data/cinder/conversion/vol_upload_ewmzoxuv {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:51 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img /opt/stack/data/cinder/conversion/vol_upload_ewmzoxuv Sep 25 17:07:51 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:52 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img /opt/stack/data/cinder/conversion/vol_upload_ewmzoxuv" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:52 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Image conversion details: src /opt/stack/data/cinder/conversion/bd9a82a9-13e0-4a07-9ff3-86de44f884dd.temp_image.c9380cee-1a24-4f0a-81ea-55849bfa7029e531bo58.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ewmzoxuv {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:07:52 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 17:07:52 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[720f423d-b44b-4100-9f6a-f6aae0b5d6b4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ewmzoxuv {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:52 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ewmzoxuv Sep 25 17:07:52 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:52 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ewmzoxuv" returned: 0 in 0.411s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.251s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Uploaded volume to glance image-id: c9380cee-1a24-4f0a-81ea-55849bfa7029. {{(pid=87232) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-f067b3f4-a942-43fa-848f-9bf6d90bbecd req-2181bfbb-a0f2-46df-913d-5468dac489a9 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.509s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-f067b3f4-a942-43fa-848f-9bf6d90bbecd req-2181bfbb-a0f2-46df-913d-5468dac489a9 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.281s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1946761131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af71ab94-afdf-436b-841f-a4838f9d29a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458d28da28eb495a89d4cd872468fe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:07:41Z,use_quota=True,user_id='3a8ddbf217f1471d95cdf27719016a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Creating volume af71ab94-afdf-436b-841f-a4838f9d29a6 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:07:54 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-27e9534d-4805-43c4-93be-3a33e0960f0c tempest-VolumesActionsTest-1438174996 None] Copy volume to image completed successfully. Sep 25 17:07:54 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6 1073741824 Sep 25 17:07:54 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-f067b3f4-a942-43fa-848f-9bf6d90bbecd req-2181bfbb-a0f2-46df-913d-5468dac489a9 tempest-AttachVolumeNegativeTest-2013442506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-182518a7-ae53-4953-ac69-dc62e05540f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9728ca2-2480-41a7-9217-138329095793', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:07:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-f067b3f4-a942-43fa-848f-9bf6d90bbecd req-2181bfbb-a0f2-46df-913d-5468dac489a9 tempest-AttachVolumeNegativeTest-2013442506 None] attachment_update completed successfully. Sep 25 17:07:54 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6 1073741824" returned: 0 in 0.656s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:55 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6 Sep 25 17:07:55 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:55 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:07:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4923922a-ae13-4eab-9c0f-80f72f7008f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af71ab94-afdf-436b-841f-a4838f9d29a6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9802f4a-2ef6-49a6-aad1-68a4628aa9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:07:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Volume volume-af71ab94-afdf-436b-841f-a4838f9d29a6 (af71ab94-afdf-436b-841f-a4838f9d29a6): created successfully Sep 25 17:07:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9802f4a-2ef6-49a6-aad1-68a4628aa9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:07:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Flow 'volume_create_manager' (08a18b1f-bc1f-46ad-a0fa-5db39d587123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:07:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dfab98e8-5e61-41c0-a27e-2af15aeed94b tempest-ServersNegativeTestJSON-2137897301 None] Created volume successfully. Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:56 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:07:56 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Acquiring lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:56 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.540s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Acquiring lock "cinder-quobyte-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Lock "cinder-quobyte-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "cinder-af71ab94-afdf-436b-841f-a4838f9d29a6-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce61e64-de56-49d7-a3f6-e8c9b9889381]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Lock "cinder-af71ab94-afdf-436b-841f-a4838f9d29a6-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "cinder-quobyte-af71ab94-afdf-436b-841f-a4838f9d29a6" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Lock "cinder-quobyte-af71ab94-afdf-436b-841f-a4838f9d29a6" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:56 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd Sep 25 17:07:56 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79ee41b-dd3d-4e16-9934-0ba4ad10dc1a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:57 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6 Sep 25 17:07:57 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:57 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" returned: 0 in 0.587s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:57 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd Sep 25 17:07:57 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:57 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6" returned: 0 in 0.550s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:57 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6 Sep 25 17:07:57 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:57 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" returned: 0 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Lock "cinder-quobyte-bd9a82a9-13e0-4a07-9ff3-86de44f884dd" released by "delete_volume" :: held 1.071s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Created reservations ['944f95cf-6399-4543-9d8e-835c7e3315b9', 'a28670b4-ec2a-4e8d-b37c-8f38346e6334', '8756fc8f-e3c8-4691-94d5-fa9eb2b19dbc', '2f5eb00e-e4b7-493b-9e23-46dc1bcfab88'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:57 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af71ab94-afdf-436b-841f-a4838f9d29a6" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Lock "cinder-quobyte-af71ab94-afdf-436b-841f-a4838f9d29a6" released by "delete_volume" :: held 0.971s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:58 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:07:58 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Created reservations ['759e1165-1a90-49b5-a16f-c4253134f347', '65e2b3bc-667f-4176-8e4b-0938c3829f47', '77eccde1-9693-4eb3-8985-412bb86e4f51', '676e166a-08d4-40f8-8f0f-db69dce58f4e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:58 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:07:58 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:58 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.327s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:07:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Deleted volume successfully. Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-44705e4f-2fb9-4e67-9c90-c06ea6411752 tempest-VolumesActionsTest-1438174996 None] Lock "cinder-bd9a82a9-13e0-4a07-9ff3-86de44f884dd-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:58 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.329s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:07:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Deleted volume successfully. Sep 25 17:07:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c43ce083-b7bc-4c00-a09e-c5175ce9ec20 tempest-ServersNegativeTestJSON-2137897301 None] Lock "cinder-af71ab94-afdf-436b-841f-a4838f9d29a6-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:07:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "cinder-2201d017-b851-4ab3-9491-c51207c4adc8-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Lock "cinder-2201d017-b851-4ab3-9491-c51207c4adc8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "cinder-quobyte-2201d017-b851-4ab3-9491-c51207c4adc8" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:07:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Lock "cinder-quobyte-2201d017-b851-4ab3-9491-c51207c4adc8" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:07:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8987abf-0e6d-45c1-afe1-730af9730725]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:07:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:59 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8 Sep 25 17:07:59 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:07:59 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 25 17:07:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8" returned: 0 in 0.552s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:07:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:07:59 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8 Sep 25 17:07:59 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:00 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2201d017-b851-4ab3-9491-c51207c4adc8" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Lock "cinder-quobyte-2201d017-b851-4ab3-9491-c51207c4adc8" released by "delete_volume" :: held 0.985s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Created reservations ['80fec057-3998-466e-8368-0adf34fb9319', '3ca2f037-7949-4263-8497-512f2148c183', 'ee9ea7d7-cb94-452d-9388-396416315a18', 'eb54d953-c4e2-4640-9e71-3d996b29f040'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:00 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:08:00 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:00 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.327s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Deleted volume successfully. Sep 25 17:08:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9be0c9db-0c3f-4049-994a-003bf70ef3ea tempest-ServersNegativeTestJSON-2137897301 None] Lock "cinder-2201d017-b851-4ab3-9491-c51207c4adc8-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:10 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:08:10 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:08:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Flow 'volume_create_manager' (aed0ea58-6025-42f8-852f-ca860e35e824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6889da-0079-4648-8270-26a0ac091182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6889da-0079-4648-8270-26a0ac091182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1771596360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7a506b-d231-4fa4-b2c2-a315d1c43c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef99fc08128b4f2f9f2963d654f3ba59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:11Z,use_quota=True,user_id='5850cbb657b04bcd963cbc21bfa6b4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9294752e-acd6-445e-88b7-16644ea9b7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9294752e-acd6-445e-88b7-16644ea9b7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc7cd4c-d08c-446f-969e-d72c029ccbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc7cd4c-d08c-446f-969e-d72c029ccbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7a506b-d231-4fa4-b2c2-a315d1c43c2e', 'volume_name': 'volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a6cefd-a4bf-4ef3-90e9-d4b3ae3ee2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a6cefd-a4bf-4ef3-90e9-d4b3ae3ee2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c558a62d-d56e-4b09-b29a-e7d7a664186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Volume 4d7a506b-d231-4fa4-b2c2-a315d1c43c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e', 'volume_size': 1} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1771596360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7a506b-d231-4fa4-b2c2-a315d1c43c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef99fc08128b4f2f9f2963d654f3ba59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:11Z,use_quota=True,user_id='5850cbb657b04bcd963cbc21bfa6b4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Creating volume 4d7a506b-d231-4fa4-b2c2-a315d1c43c2e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:08:11 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:08:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:11 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e 1073741824 Sep 25 17:08:11 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:12 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e 1073741824" returned: 0 in 1.152s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:12 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e Sep 25 17:08:12 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:12 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e" returned: 0 in 0.446s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:08:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c558a62d-d56e-4b09-b29a-e7d7a664186e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10631ee8-83bf-42f3-bdde-d6dba4b65e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Volume volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e (4d7a506b-d231-4fa4-b2c2-a315d1c43c2e): created successfully Sep 25 17:08:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10631ee8-83bf-42f3-bdde-d6dba4b65e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Flow 'volume_create_manager' (aed0ea58-6025-42f8-852f-ca860e35e824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5fcee60d-1d57-4844-9ed4-202e0e99870b tempest-AttachVolumeTestJSON-1650136813 None] Created volume successfully. Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Flow 'volume_create_manager' (7fb6a441-47ca-4667-b0d7-dbaeed926946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864b7ffb-3c94-4065-8fd5-a7ebf8a38add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864b7ffb-3c94-4065-8fd5-a7ebf8a38add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1496167588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408c2e51-b2d3-4c07-9dc2-06f41e61e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1859253c2ae04511b75fdb083d02ad44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:14Z,use_quota=True,user_id='b8faad249e2944d8b5437b485790f6bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b0f43d-f595-4c3c-880c-9ebdf3895668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b0f43d-f595-4c3c-880c-9ebdf3895668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b19b300-7853-448d-a150-5d786ecdcd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b19b300-7853-448d-a150-5d786ecdcd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408c2e51-b2d3-4c07-9dc2-06f41e61e0ec', 'volume_name': 'volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484be490-00eb-44ec-b58b-cdeaad783110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484be490-00eb-44ec-b58b-cdeaad783110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40580ea9-997d-4981-8a22-39e49d86d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Volume 408c2e51-b2d3-4c07-9dc2-06f41e61e0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec', 'volume_size': 1} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1496167588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408c2e51-b2d3-4c07-9dc2-06f41e61e0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1859253c2ae04511b75fdb083d02ad44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:14Z,use_quota=True,user_id='b8faad249e2944d8b5437b485790f6bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Creating volume 408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:08:14 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:08:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:14 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec 1073741824 Sep 25 17:08:14 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:15 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec 1073741824" returned: 0 in 1.042s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:15 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec Sep 25 17:08:15 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8ef127dd-baf1-476a-be45-826ea4bd04ce req-a884efc5-e3ef-4a1e-aea8-31052fafb624 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:16 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec" returned: 0 in 0.394s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8ef127dd-baf1-476a-be45-826ea4bd04ce req-a884efc5-e3ef-4a1e-aea8-31052fafb624 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.256s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40580ea9-997d-4981-8a22-39e49d86d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5728433-3a75-4ec6-b264-ae5aac40a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-8ef127dd-baf1-476a-be45-826ea4bd04ce req-a884efc5-e3ef-4a1e-aea8-31052fafb624 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Volume volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec (408c2e51-b2d3-4c07-9dc2-06f41e61e0ec): created successfully Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5728433-3a75-4ec6-b264-ae5aac40a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Flow 'volume_create_manager' (7fb6a441-47ca-4667-b0d7-dbaeed926946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-20626bf8-5b9e-4e37-abb1-ddc09c476c83 tempest-VolumesCloneTest-721866114 None] Created volume successfully. Sep 25 17:08:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-8ef127dd-baf1-476a-be45-826ea4bd04ce req-a884efc5-e3ef-4a1e-aea8-31052fafb624 tempest-AttachVolumeTestJSON-1650136813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49a93d59-f7e2-4aea-96b5-89afc7446855', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:08:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-8ef127dd-baf1-476a-be45-826ea4bd04ce req-a884efc5-e3ef-4a1e-aea8-31052fafb624 tempest-AttachVolumeTestJSON-1650136813 None] attachment_update completed successfully. Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Flow 'volume_create_manager' (07bc84f7-15e8-45b1-9db7-91b281d2baa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ef588a-d70e-4004-b3ee-721a3176c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ef588a-d70e-4004-b3ee-721a3176c910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1508810002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48d0d99-eb27-434c-ad8d-ca9fa86bab8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1859253c2ae04511b75fdb083d02ad44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=408c2e51-b2d3-4c07-9dc2-06f41e61e0ec,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:18Z,use_quota=True,user_id='b8faad249e2944d8b5437b485790f6bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe73382-2526-4e5f-adb4-7781119d5470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe73382-2526-4e5f-adb4-7781119d5470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cc207c-e855-4ecd-b5f2-d67834ceafdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cc207c-e855-4ecd-b5f2-d67834ceafdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c48d0d99-eb27-434c-ad8d-ca9fa86bab8f', 'volume_name': 'volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f', 'volume_size': 2, 'source_volid': '408c2e51-b2d3-4c07-9dc2-06f41e61e0ec', 'source_volstatus': 'available'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b9af2e-1851-4d36-88ba-62cf14ef7dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b9af2e-1851-4d36-88ba-62cf14ef7dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c012663-53f0-4ab3-8774-35c51ef0ae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Volume c48d0d99-eb27-434c-ad8d-ca9fa86bab8f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f', 'volume_size': 2, 'source_volid': '408c2e51-b2d3-4c07-9dc2-06f41e61e0ec', 'source_volstatus': 'available'} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:18 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Cloning volume 408c2e51-b2d3-4c07-9dc2-06f41e61e0ec to volume c48d0d99-eb27-434c-ad8d-ca9fa86bab8f Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Creating offline snapshot 02ed6d77-8670-4b0d-aff2-a9393ee4fc93 of volume 408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e606fd77-cb0e-4453-a811-17cdfa9af605]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:18 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec Sep 25 17:08:18 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:19 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec" returned: 0 in 0.654s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:19 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 1G Sep 25 17:08:19 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:20 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 1G" returned: 0 in 1.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:20 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 Sep 25 17:08:20 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:20 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Flow 'volume_create_manager' (f8a61a40-3af5-412b-99c7-3ba605db0d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dc9636-3033-47cf-b345-b8c2a610a123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dc9636-3033-47cf-b345-b8c2a610a123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-730038685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5385687-0153-42e1-a519-17faf7684caa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2822a10c1f284852a70c550ace29102e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:21Z,use_quota=True,user_id='6de0bec11dd74d5abe6d364b515e9206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fe2080-3652-4f45-8bf3-2c6d7c5a913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fe2080-3652-4f45-8bf3-2c6d7c5a913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e4180f-b6f6-4127-8db5-81b191fd931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e4180f-b6f6-4127-8db5-81b191fd931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5385687-0153-42e1-a519-17faf7684caa', 'volume_name': 'volume-c5385687-0153-42e1-a519-17faf7684caa', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:21 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49b0673-671a-41b0-a24a-6a85f817e713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49b0673-671a-41b0-a24a-6a85f817e713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90de3c49-ec9b-4a6f-91ae-4039ccf67068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Volume c5385687-0153-42e1-a519-17faf7684caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5385687-0153-42e1-a519-17faf7684caa', 'volume_size': 1} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93" returned: 0 in 0.635s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:21 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 is being set with open permissions: ugo+rw Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:21 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 Sep 25 17:08:21 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:21 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93" returned: 0 in 0.394s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:21 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.info Sep 25 17:08:21 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:22 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.info" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:22 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.info is being set with open permissions: ugo+rw Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:22 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.info Sep 25 17:08:22 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:22 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.info" returned: 0 in 0.423s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Acquiring lock "cinder-quobyte-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Lock "cinder-quobyte-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] snapshot: 02ed6d77-8670-4b0d-aff2-a9393ee4fc93, volume: c48d0d99-eb27-434c-ad8d-ca9fa86bab8f, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[937fdb15-90f9-4abb-8677-44a6afa2aa42]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:22 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 Sep 25 17:08:22 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:23 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93" returned: 0 in 0.546s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:08:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c847bb-5e9b-43cd-99e1-fe96cda0c4ad]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:23 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec Sep 25 17:08:23 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:23 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec" returned: 0 in 0.655s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:08:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:08:23 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:08:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:23 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f Sep 25 17:08:23 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=19,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:08:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:08:34 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" returned: 0 in 10.396s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec, size 1024.00 MB, duration 10.40 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:08:34 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Converted 1024.00 MB image at 98.46 MB/s Sep 25 17:08:34 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f is being set with open permissions: ugo+rw Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:34 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f Sep 25 17:08:34 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:34 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" returned: 0 in 0.292s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Lock "cinder-quobyte-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" released by "_copy_volume_from_snapshot" :: held 11.994s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Acquiring lock "cinder-quobyte-02ed6d77-8670-4b0d-aff2-a9393ee4fc93" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Lock "cinder-quobyte-02ed6d77-8670-4b0d-aff2-a9393ee4fc93" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Deleting offline snapshot 02ed6d77-8670-4b0d-aff2-a9393ee4fc93 of volume 408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] snapshot_file for this snap is: volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eefc0e7-5e1b-42a8-b0a6-b43653f7e05c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:34 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 Sep 25 17:08:34 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:35 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93" returned: 0 in 0.456s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:08:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f74e107-5781-43e1-95b3-b1b7d4eb4a60]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:35 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec Sep 25 17:08:35 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:35 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec" returned: 0 in 0.693s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:35 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 Sep 25 17:08:35 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:36 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93" returned: 0 in 0.631s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:36 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93 Sep 25 17:08:36 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:37 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec.02ed6d77-8670-4b0d-aff2-a9393ee4fc93" returned: 0 in 0.627s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Lock "cinder-quobyte-02ed6d77-8670-4b0d-aff2-a9393ee4fc93" released by "_delete_snapshot" :: held 2.561s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.842s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.177s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-730038685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5385687-0153-42e1-a519-17faf7684caa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2822a10c1f284852a70c550ace29102e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:21Z,use_quota=True,user_id='6de0bec11dd74d5abe6d364b515e9206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Creating volume c5385687-0153-42e1-a519-17faf7684caa {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:08:37 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:37 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa 1073741824 Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c012663-53f0-4ab3-8774-35c51ef0ae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f', 'volume_size': 2, 'source_volid': '408c2e51-b2d3-4c07-9dc2-06f41e61e0ec', 'source_volstatus': 'available'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:37 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc71c5b-79fd-40a5-8198-c1c9a1793445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Volume volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f (c48d0d99-eb27-434c-ad8d-ca9fa86bab8f): created successfully Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc71c5b-79fd-40a5-8198-c1c9a1793445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Flow 'volume_create_manager' (07bc84f7-15e8-45b1-9db7-91b281d2baa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ce0abe4b-5ba6-4882-962e-77807aecea4c tempest-VolumesCloneTest-721866114 None] Created volume successfully. Sep 25 17:08:38 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa 1073741824" returned: 0 in 0.744s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:38 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa Sep 25 17:08:38 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Acquiring lock "cinder-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Lock "cinder-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Acquiring lock "cinder-quobyte-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Lock "cinder-quobyte-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:38 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa" returned: 0 in 0.524s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a39dd16-13b2-43fd-8110-f697708e9f84]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90de3c49-ec9b-4a6f-91ae-4039ccf67068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5385687-0153-42e1-a519-17faf7684caa', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e40ee37-3310-488b-a0ba-925e3e5cadfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Volume volume-c5385687-0153-42e1-a519-17faf7684caa (c5385687-0153-42e1-a519-17faf7684caa): created successfully Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e40ee37-3310-488b-a0ba-925e3e5cadfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Flow 'volume_create_manager' (f8a61a40-3af5-412b-99c7-3ba605db0d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-0d67c242-8f19-458b-963f-715e12b2b7ac req-da32fd79-de69-4d93-8469-5622840713a9 tempest-VolumesGetTestJSON-1531936601 None] Created volume successfully. Sep 25 17:08:38 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f Sep 25 17:08:38 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:39 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" returned: 0 in 0.652s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:39 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f Sep 25 17:08:39 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Acquiring lock "cinder-c5385687-0153-42e1-a519-17faf7684caa-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Lock "cinder-c5385687-0153-42e1-a519-17faf7684caa-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Acquiring lock "cinder-quobyte-c5385687-0153-42e1-a519-17faf7684caa" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Lock "cinder-quobyte-c5385687-0153-42e1-a519-17faf7684caa" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02cfd5f-db48-49ea-a595-490427ae979e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:39 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Lock "cinder-quobyte-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f" released by "delete_volume" :: held 1.323s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:39 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa Sep 25 17:08:39 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Created reservations ['21c6721f-4ad6-4dea-92cb-12d35a054cad', '20780cd5-6203-4712-8a6a-ed48573be879', '9bc67011-a8f0-4ef9-ad66-8968671bf290', '964a3953-1293-4bd9-8e81-dbf5f3b82d11'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:40 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:08:40 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:40 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa" returned: 0 in 0.612s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:40 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa Sep 25 17:08:40 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:40 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Deleted volume successfully. Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ff68c540-8eae-4233-9364-4573a36e2b77 tempest-VolumesCloneTest-721866114 None] Lock "cinder-c48d0d99-eb27-434c-ad8d-ca9fa86bab8f-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:40 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c5385687-0153-42e1-a519-17faf7684caa" returned: 0 in 0.368s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Lock "cinder-quobyte-c5385687-0153-42e1-a519-17faf7684caa" released by "delete_volume" :: held 1.072s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.quota [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Created reservations ['55d75ba7-4c30-4bc9-92f5-fe9216fe2dbd', '4922d5c7-2ae8-422b-8e9a-a1051b4507bb', '111cbb6a-b7cb-40d4-ac26-8bc6e9409530', '1a2515d1-1f83-49bd-8bbe-2110b698c6a4'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Acquiring lock "cinder-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:40 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:08:40 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Lock "cinder-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Acquiring lock "cinder-quobyte-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Lock "cinder-quobyte-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[53296b07-c2df-4cc2-8ec1-6159b5bb5667]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:41 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec Sep 25 17:08:41 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:41 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:41 devstack cinder-volume[87232]: DEBUG cinder.manager [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Deleted volume successfully. Sep 25 17:08:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-35398dba-7ab6-492a-b8aa-db7518d86a80 req-1deac588-471e-4a5c-840d-88fec404f833 tempest-VolumesGetTestJSON-1531936601 None] Lock "cinder-c5385687-0153-42e1-a519-17faf7684caa-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:41 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec" returned: 0 in 0.523s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:41 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec Sep 25 17:08:41 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:42 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Lock "cinder-quobyte-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec" released by "delete_volume" :: held 1.025s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Created reservations ['260f1cfa-d7a9-43e2-8e22-bfb9c3cad287', 'ef377605-7472-4452-aa2b-4dd9a6277862', '9f8e74f1-b53e-454d-9b4c-f84afaac16e8', 'bb8d1261-c18f-4970-bbf5-c66101ac2324'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:42 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:08:42 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:42 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Deleted volume successfully. Sep 25 17:08:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-16b65637-4b83-4891-9280-2ab7de9295ef tempest-VolumesCloneTest-721866114 None] Lock "cinder-408c2e51-b2d3-4c07-9dc2-06f41e61e0ec-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-ff76d099-499d-41bc-8a09-41cdcc90e593 req-afa5f309-5e3d-45cf-940b-4a310ac46a9d tempest-AttachVolumeNegativeTest-2013442506 None] Terminate volume connection completed successfully. Sep 25 17:08:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-ff76d099-499d-41bc-8a09-41cdcc90e593 req-afa5f309-5e3d-45cf-940b-4a310ac46a9d tempest-AttachVolumeNegativeTest-2013442506 None] Deleting attachment b9728ca2-2480-41a7-9217-138329095793. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:08:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bfde734c-9822-420b-964a-1b3dd4f95363 tempest-GroupSnapshotsTest-533964219 None] Group tempest-GroupSnapshotsTest-Group-1273320871: creating Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Flow 'volume_create_manager' (32924d62-f8ff-4bc1-a6f4-173bab52f02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbe704f-a214-4578-97c0-6d9a91d7da18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bfde734c-9822-420b-964a-1b3dd4f95363 tempest-GroupSnapshotsTest-533964219 None] Group tempest-GroupSnapshotsTest-Group-1273320871: created successfully Sep 25 17:08:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bfde734c-9822-420b-964a-1b3dd4f95363 tempest-GroupSnapshotsTest-533964219 None] Create group completed successfully. Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbe704f-a214-4578-97c0-6d9a91d7da18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-687071635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671e2b21-9a27-49a1-88a9-1b0678f317f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd47e56ba62a49b5b023abc2ddf4a138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:50Z,use_quota=True,user_id='4c2d22dca8444365979cf7171fa59b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52aab46-251b-4722-a217-c46295275320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52aab46-251b-4722-a217-c46295275320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4937040b-f861-4bf0-9efd-42800a8c6e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4937040b-f861-4bf0-9efd-42800a8c6e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671e2b21-9a27-49a1-88a9-1b0678f317f7', 'volume_name': 'volume-671e2b21-9a27-49a1-88a9-1b0678f317f7', 'volume_size': 2}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e79526e-b181-41ac-8dd0-029deb05da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e79526e-b181-41ac-8dd0-029deb05da21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d1f822-4f9a-4468-8a41-61a7bea15744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Volume 671e2b21-9a27-49a1-88a9-1b0678f317f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671e2b21-9a27-49a1-88a9-1b0678f317f7', 'volume_size': 2} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-687071635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671e2b21-9a27-49a1-88a9-1b0678f317f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd47e56ba62a49b5b023abc2ddf4a138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:50Z,use_quota=True,user_id='4c2d22dca8444365979cf7171fa59b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Creating volume 671e2b21-9a27-49a1-88a9-1b0678f317f7 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:08:49 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:08:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 2147483648 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:49 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 2147483648 Sep 25 17:08:49 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:50 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 2147483648" returned: 0 in 0.781s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:50 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 Sep 25 17:08:50 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:51 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d1f822-4f9a-4468-8a41-61a7bea15744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671e2b21-9a27-49a1-88a9-1b0678f317f7', 'volume_size': 2}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c6c905-7d58-498c-95d2-545522bcac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Volume volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 (671e2b21-9a27-49a1-88a9-1b0678f317f7): created successfully Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c6c905-7d58-498c-95d2-545522bcac3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Flow 'volume_create_manager' (32924d62-f8ff-4bc1-a6f4-173bab52f02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9fc1c916-727f-45a2-9dd0-7b6e2895c695 tempest-VolumesCloneNegativeTest-1454778441 None] Created volume successfully. Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Flow 'volume_create_manager' (28bb1831-8f29-4023-a088-a3497e3042e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54d39a3-6eae-4409-bf46-242fc9536cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54d39a3-6eae-4409-bf46-242fc9536cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-110830967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f3cf1fe-6e3a-455a-bd4c-2b98c71b1bff,host='devstack@QuobyteHD#QuobyteHD',id=0a144542-3b1a-4f10-bacf-7b5a6be33ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286954bf1fa84f98ae41a5ca284be1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:51Z,use_quota=True,user_id='521b198f2ed24e418a79d73fba1b2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d0a97ce-1ad3-482c-8d5f-dcff2f7a8bbe),volume_type_id=2d0a97ce-1ad3-482c-8d5f-dcff2f7a8bbe)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43053373-5759-4aac-921e-c5343d1065d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43053373-5759-4aac-921e-c5343d1065d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09207198-7d88-4861-b2a1-16b698101082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09207198-7d88-4861-b2a1-16b698101082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a144542-3b1a-4f10-bacf-7b5a6be33ae7', 'volume_name': 'volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b937fb5-4617-4e74-9e4d-5cb04b036956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b937fb5-4617-4e74-9e4d-5cb04b036956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5d99d3-32ec-4a61-b0fc-86dd67a10253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Volume 0a144542-3b1a-4f10-bacf-7b5a6be33ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7', 'volume_size': 1} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f3cf1fe-6e3a-455a-bd4c-2b98c71b1bff,created_at=2026-09-25T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-110830967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f3cf1fe-6e3a-455a-bd4c-2b98c71b1bff,host='devstack@QuobyteHD#QuobyteHD',id=0a144542-3b1a-4f10-bacf-7b5a6be33ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286954bf1fa84f98ae41a5ca284be1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:08:51Z,use_quota=True,user_id='521b198f2ed24e418a79d73fba1b2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d0a97ce-1ad3-482c-8d5f-dcff2f7a8bbe),volume_type_id=2d0a97ce-1ad3-482c-8d5f-dcff2f7a8bbe)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Creating volume 0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:08:51 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:51 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 1073741824 Sep 25 17:08:51 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-ab81388d-d0c8-48aa-8e05-39293ee38bb2 req-ee000da0-cbe9-41fe-9d82-84da63000ae6 tempest-AttachVolumeTestJSON-1650136813 None] Terminate volume connection completed successfully. Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-ab81388d-d0c8-48aa-8e05-39293ee38bb2 req-ee000da0-cbe9-41fe-9d82-84da63000ae6 tempest-AttachVolumeTestJSON-1650136813 None] Deleting attachment 49a93d59-f7e2-4aea-96b5-89afc7446855. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Acquiring lock "cinder-671e2b21-9a27-49a1-88a9-1b0678f317f7-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "cinder-671e2b21-9a27-49a1-88a9-1b0678f317f7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Acquiring lock "cinder-quobyte-671e2b21-9a27-49a1-88a9-1b0678f317f7" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:08:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "cinder-quobyte-671e2b21-9a27-49a1-88a9-1b0678f317f7" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:08:52 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7ec2f7-1ccc-4bd8-a39e-93673912efc6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:52 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 Sep 25 17:08:52 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:52 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 1073741824" returned: 0 in 0.903s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:52 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 Sep 25 17:08:52 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:52 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7" returned: 0 in 0.786s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:52 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7 Sep 25 17:08:52 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:53 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" returned: 0 in 0.471s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5d99d3-32ec-4a61-b0fc-86dd67a10253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ca20f3-ffea-4665-af9b-4e36d3096778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:08:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Volume volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 (0a144542-3b1a-4f10-bacf-7b5a6be33ae7): created successfully Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ca20f3-ffea-4665-af9b-4e36d3096778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Flow 'volume_create_manager' (28bb1831-8f29-4023-a088-a3497e3042e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:08:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-27257238-9131-4aa4-8502-2f95c68877db tempest-GroupSnapshotsTest-533964219 None] Created volume successfully. Sep 25 17:08:53 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-671e2b21-9a27-49a1-88a9-1b0678f317f7" returned: 0 in 0.423s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "cinder-quobyte-671e2b21-9a27-49a1-88a9-1b0678f317f7" released by "delete_volume" :: held 1.288s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Created reservations ['d1f36bad-afcf-4b02-b974-e1fc59b53dda', '4d9aa2c8-b10f-4585-9898-b26f4f177c16', '65e987aa-8dcc-4deb-ae3d-cbe2efb1e8f3', '026ff91c-b7c9-4355-8b9c-399056d4c2e0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:53 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:08:53 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:53 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.268s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Deleted volume successfully. Sep 25 17:08:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f3c4510a-59f7-4f44-ab55-e3e1cb46b094 tempest-VolumesCloneNegativeTest-1454778441 None] Lock "cinder-671e2b21-9a27-49a1-88a9-1b0678f317f7-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:08:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] GroupSnapshot a4fc1597-3f69-448d-b459-1f5b2cf05515: creating. Sep 25 17:08:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Group snapshot a4fc1597-3f69-448d-b459-1f5b2cf05515: creating. {{(pid=87232) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:08:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Creating offline snapshot 8d6a7b2c-ad31-4da8-852b-481d3b1f7241 of volume 0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:08:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[48894aff-2984-42f4-b60a-b1b8def77841]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:08:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:54 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 Sep 25 17:08:54 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:55 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" returned: 0 in 0.543s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:55 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 1G Sep 25 17:08:55 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:56 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:08:56 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:56 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 1G" returned: 0 in 0.812s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:56 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 Sep 25 17:08:56 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:56 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.676s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:08:56 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241" returned: 0 in 0.711s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:56 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:08:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:56 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 Sep 25 17:08:56 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:57 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:57 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.info Sep 25 17:08:57 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:57 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.info" returned: 0 in 0.501s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:57 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:08:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:08:57 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.info Sep 25 17:08:57 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:08:58 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Sep 25 17:08:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.info" returned: 0 in 0.461s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:08:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.660s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:08:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f055b42c-b95f-438b-b1a3-cb698e49041e tempest-GroupSnapshotsTest-533964219 None] group_snapshot a4fc1597-3f69-448d-b459-1f5b2cf05515: created successfully Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-8d6a7b2c-ad31-4da8-852b-481d3b1f7241-42194ffe-2b2f-45f8-a6d9-c21499133fe2" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-8d6a7b2c-ad31-4da8-852b-481d3b1f7241-42194ffe-2b2f-45f8-a6d9-c21499133fe2" acquired by "_create_volume_from_snapshot" :: waited 0.072s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Creating volume 42194ffe-2b2f-45f8-a6d9-c21499133fe2 from snapshot 8d6a7b2c-ad31-4da8-852b-481d3b1f7241 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.078s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-42194ffe-2b2f-45f8-a6d9-c21499133fe2" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-42194ffe-2b2f-45f8-a6d9-c21499133fe2" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] snapshot: 8d6a7b2c-ad31-4da8-852b-481d3b1f7241, volume: 42194ffe-2b2f-45f8-a6d9-c21499133fe2, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5faca3c-ac7b-4cdd-9be0-0a5a1f356341]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:02 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 Sep 25 17:09:02 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:02 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241" returned: 0 in 0.751s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:09:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6dc7de-fbc6-4c8d-8129-19640be8b67a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:02 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 Sep 25 17:09:02 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:03 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" returned: 0 in 0.641s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:03 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 Sep 25 17:09:03 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Flow 'volume_create_manager' (e9f14286-8c34-452d-bb7a-34a403277543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91dae1c8-ca92-425b-9a4f-fbfc5647f46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91dae1c8-ca92-425b-9a4f-fbfc5647f46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-734280506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acea2e60-4c12-46ea-97aa-645a15b2d715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e097f907f3c4e169e194705358409d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:03Z,use_quota=True,user_id='e235e81e69264826a16855bab40d6057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aad4c31-4dee-41b6-926f-b5805d27c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aad4c31-4dee-41b6-926f-b5805d27c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f34ce0-5e8b-49a1-b24f-190315916a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:03 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:09:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f34ce0-5e8b-49a1-b24f-190315916a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'acea2e60-4c12-46ea-97aa-645a15b2d715', 'volume_name': 'volume-acea2e60-4c12-46ea-97aa-645a15b2d715', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac76dc96-b1d1-4fdd-b3aa-415b565be86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac76dc96-b1d1-4fdd-b3aa-415b565be86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e279084-d6ed-4dc5-9943-1237ec38bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Volume acea2e60-4c12-46ea-97aa-645a15b2d715: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-acea2e60-4c12-46ea-97aa-645a15b2d715', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:09:04 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Trying to clone acea2e60-4c12-46ea-97aa-645a15b2d715 from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:09:05 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD, size 20.69 MB, duration 1.42 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:09:05 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Image download 20.69 MB at 14.55 MB/s Sep 25 17:09:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[de49ae94-924c-4280-9773-7702531d6ef6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:07 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD Sep 25 17:09:07 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:08 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD" returned: 0 in 1.533s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:08 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 is fetched for user e235e81e69264826a16855bab40d6057. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:09:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[666d7054-b6dd-4305-9409-702432f923de]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:09 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD Sep 25 17:09:09 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:09 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD" returned: 0 in 1.196s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:16 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2" returned: 0 in 13.003s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7, size 1024.00 MB, duration 13.00 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:09:16 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Converted 1024.00 MB image at 78.74 MB/s Sep 25 17:09:16 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:16 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 Sep 25 17:09:16 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:16 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-42194ffe-2b2f-45f8-a6d9-c21499133fe2" released by "_copy_volume_from_snapshot" :: held 15.093s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-8d6a7b2c-ad31-4da8-852b-481d3b1f7241-42194ffe-2b2f-45f8-a6d9-c21499133fe2" released by "_create_volume_from_snapshot" :: held 15.313s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.392s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.787s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-734280506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acea2e60-4c12-46ea-97aa-645a15b2d715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e097f907f3c4e169e194705358409d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:03Z,use_quota=True,user_id='e235e81e69264826a16855bab40d6057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Creating volume acea2e60-4c12-46ea-97aa-645a15b2d715 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:16 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:09:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:16 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 1073741824 Sep 25 17:09:16 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e8c487b1-aea5-44bf-b2ef-651c1220e1db tempest-GroupSnapshotsTest-533964219 None] Create group from source-snapshot-a4fc1597-3f69-448d-b459-1f5b2cf05515 completed successfully. Sep 25 17:09:17 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 1073741824" returned: 0 in 0.603s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:17 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 Sep 25 17:09:17 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:17 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715" returned: 0 in 0.470s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:17 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Attempting download of fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume acea2e60-4c12-46ea-97aa-645a15b2d715. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:09:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b432235-85f8-4e26-a882-89a71b22d4de]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_odmdpvjx {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:18 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_odmdpvjx Sep 25 17:09:18 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-42194ffe-2b2f-45f8-a6d9-c21499133fe2" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-42194ffe-2b2f-45f8-a6d9-c21499133fe2" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3438b690-c0b9-4c82-a10f-ce55696746cb]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:18 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_odmdpvjx" returned: 0 in 0.569s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_odmdpvjx {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:18 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 Sep 25 17:09:18 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:18 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_odmdpvjx Sep 25 17:09:18 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:19 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2" returned: 0 in 0.617s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:19 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_odmdpvjx" returned: 1 in 0.455s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_odmdpvjx' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bdb6d4-38b0-4c0d-9028-5d3d628dea49]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:19 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2 Sep 25 17:09:19 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:19 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD Sep 25 17:09:19 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:19 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-42194ffe-2b2f-45f8-a6d9-c21499133fe2" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-42194ffe-2b2f-45f8-a6d9-c21499133fe2" released by "delete_volume" :: held 0.987s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:19 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] fe054675-e641-4e31-bdb5-5e70f8a00fc9 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Created reservations ['d82c041c-21a4-4c35-a0c5-f86cb8c11a6d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:19 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 Sep 25 17:09:19 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:19 devstack cinder-volume[87232]: WARNING cinder.quota [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-493527422 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-493527422, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:09:19 devstack cinder-volume[87232]: WARNING cinder.quota [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-493527422 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-493527422, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Created reservations ['f2390065-5a0f-4314-adbc-03fbd80003b6', 'a3c9327d-8389-4bcb-94b5-1a9ded75f5c6', 'b4c32c2d-05ef-4f8d-9347-2290f5fde6dd', '68a83e17-5aec-4fe4-bf3a-24facfbbc2f1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:20 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:09:20 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:20 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.420s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:20 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f75fcf28-61de-47dd-b667-053d529a3053 tempest-GroupSnapshotsTest-533964219 None] Delete group completed successfully. Sep 25 17:09:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] group_snapshot a4fc1597-3f69-448d-b459-1f5b2cf05515: deleting Sep 25 17:09:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] group_snapshot a4fc1597-3f69-448d-b459-1f5b2cf05515: deleting {{(pid=87232) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:09:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-8d6a7b2c-ad31-4da8-852b-481d3b1f7241" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-8d6a7b2c-ad31-4da8-852b-481d3b1f7241" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Deleting offline snapshot 8d6a7b2c-ad31-4da8-852b-481d3b1f7241 of volume 0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:09:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] snapshot_file for this snap is: volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:09:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c7dba-f7a7-48ec-8fca-cfc018e7e648]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:21 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 Sep 25 17:09:21 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:22 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241" returned: 0 in 0.712s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:09:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15f92ae-b466-402b-b274-6dc5a925b8fd]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:22 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 Sep 25 17:09:22 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:22 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715" returned: 0 in 3.288s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:22 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_jrbkbpljdevstack@QuobyteHD, size 112.00 MB, duration 3.29 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:09:22 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Converted 112.00 MB image at 34.05 MB/s Sep 25 17:09:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:22 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 1G Sep 25 17:09:22 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:23 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" returned: 0 in 0.737s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:23 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 Sep 25 17:09:23 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:23 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 1G" returned: 0 in 0.478s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Downloaded image fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume acea2e60-4c12-46ea-97aa-645a15b2d715 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 for user e235e81e69264826a16855bab40d6057 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Marking volume acea2e60-4c12-46ea-97aa-645a15b2d715 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Copying metadata from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 to acea2e60-4c12-46ea-97aa-645a15b2d715. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Creating volume glance metadata for volume acea2e60-4c12-46ea-97aa-645a15b2d715 backed by image fe054675-e641-4e31-bdb5-5e70f8a00fc9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e279084-d6ed-4dc5-9943-1237ec38bf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acea2e60-4c12-46ea-97aa-645a15b2d715', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8774ef-c2cb-481b-83f8-66aee878a431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Volume volume-acea2e60-4c12-46ea-97aa-645a15b2d715 (acea2e60-4c12-46ea-97aa-645a15b2d715): created successfully Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8774ef-c2cb-481b-83f8-66aee878a431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Flow 'volume_create_manager' (e9f14286-8c34-452d-bb7a-34a403277543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-eb6eeb60-c362-4eeb-9a35-2df5bc716f35 tempest-VolumesExtendTest-1238350284 None] Created volume successfully. Sep 25 17:09:23 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241" returned: 0 in 0.493s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:23 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241 Sep 25 17:09:23 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:23 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7.8d6a7b2c-ad31-4da8-852b-481d3b1f7241" returned: 0 in 0.300s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-8d6a7b2c-ad31-4da8-852b-481d3b1f7241" released by "_delete_snapshot" :: held 2.449s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" released by "delete_snapshot" :: held 2.503s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:23 devstack cinder-volume[87232]: WARNING cinder.quota [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-493527422 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-493527422, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:09:23 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] Created reservations ['21c4813f-fafd-4414-aaa8-4b9d2a292b57', 'd63ef962-ecc0-49f7-83a0-d2ec3780ad01', 'a3f38647-a9b1-4f2b-b841-4a4ba5ff7068', 'bbbaeca7-05a0-40e2-bbfb-52b61494125b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4a5a2b5c-cd44-40dc-b1a3-02910498126a tempest-GroupSnapshotsTest-533964219 None] group_snapshot a4fc1597-3f69-448d-b459-1f5b2cf05515: deleted successfully Sep 25 17:09:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e1a4f549-8572-45a8-a83d-289db2b5316b tempest-VolumesExtendTest-1238350284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e1a4f549-8572-45a8-a83d-289db2b5316b tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b615f3-d5fe-41b3-8cc2-8cbcdce34fe0]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a4f549-8572-45a8-a83d-289db2b5316b tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:25 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 Sep 25 17:09:25 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" acquired by "delete_volume" :: waited 0.048s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057a729-bb90-4b33-b40a-025d56ed3c52]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:26 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a4f549-8572-45a8-a83d-289db2b5316b tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715" returned: 0 in 0.902s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a4f549-8572-45a8-a83d-289db2b5316b tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 2G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:26 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 Sep 25 17:09:26 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a4f549-8572-45a8-a83d-289db2b5316b tempest-VolumesExtendTest-1238350284 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 2G" returned: 0 in 0.206s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e1a4f549-8572-45a8-a83d-289db2b5316b tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.177s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e1a4f549-8572-45a8-a83d-289db2b5316b tempest-VolumesExtendTest-1238350284 None] Extend volume completed successfully. Sep 25 17:09:26 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" returned: 0 in 0.662s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:26 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7 Sep 25 17:09:26 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:26 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" returned: 0 in 0.412s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-0a144542-3b1a-4f10-bacf-7b5a6be33ae7" released by "delete_volume" :: held 1.211s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:27 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Created reservations ['ee7ecfa3-714b-4c68-9ed1-bc49fc77e62b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:27 devstack cinder-volume[87232]: WARNING cinder.db.api [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-493527422'] Sep 25 17:09:27 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Created reservations ['a8abdf81-6da5-47ce-bf50-a84eb3ee7628', '578935d1-8e44-4008-b2dd-ec65625110da', '66381167-00bf-4e8a-b3c2-0fac85a29243', 'da45a1ca-b509-4a66-a6b1-099c4696afc5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:27 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:09:27 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Acquiring lock "cinder-acea2e60-4c12-46ea-97aa-645a15b2d715-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:28 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.441s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2bab0a2c-9e6e-4891-a87a-f2a8502c4f6a tempest-GroupSnapshotsTest-533964219 None] Delete group completed successfully. Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Lock "cinder-acea2e60-4c12-46ea-97aa-645a15b2d715-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Acquiring lock "cinder-quobyte-acea2e60-4c12-46ea-97aa-645a15b2d715" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Lock "cinder-quobyte-acea2e60-4c12-46ea-97aa-645a15b2d715" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a1ea2-f72e-4b82-a206-771e4876a023]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:28 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 Sep 25 17:09:28 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:28 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715" returned: 0 in 0.465s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:28 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715 Sep 25 17:09:28 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1e47fff0-4137-4940-97a5-73d7b79e08e0 tempest-GroupSnapshotsTest-533964219 None] Group tempest-GroupSnapshotsTest-Group-1747668156: creating Sep 25 17:09:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1e47fff0-4137-4940-97a5-73d7b79e08e0 tempest-GroupSnapshotsTest-533964219 None] Group tempest-GroupSnapshotsTest-Group-1747668156: created successfully Sep 25 17:09:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1e47fff0-4137-4940-97a5-73d7b79e08e0 tempest-GroupSnapshotsTest-533964219 None] Create group completed successfully. Sep 25 17:09:28 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-acea2e60-4c12-46ea-97aa-645a15b2d715" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Lock "cinder-quobyte-acea2e60-4c12-46ea-97aa-645a15b2d715" released by "delete_volume" :: held 0.825s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:28 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Created reservations ['b6865a66-6fea-4256-9310-7d8c27d10f13', '04e9f923-4882-477a-9b69-4a0d96d15de5', '1477de45-7f82-40b3-85fc-0ca5fa3d3195', 'e74212fb-6724-4364-b77d-e21ba71a8c1f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:29 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:09:29 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:29 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Deleted volume successfully. Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e8809ca-d006-4cb2-af93-8b5f29f3d13d tempest-VolumesExtendTest-1238350284 None] Lock "cinder-acea2e60-4c12-46ea-97aa-645a15b2d715-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Flow 'volume_create_manager' (b0e92e60-4707-4a35-9040-2d590aed7679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91972b2-1e16-4c6f-a316-369c72cea657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91972b2-1e16-4c6f-a316-369c72cea657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-137210701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e097f907f3c4e169e194705358409d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:30Z,use_quota=True,user_id='e235e81e69264826a16855bab40d6057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6467225f-23c8-4800-b2c1-6dd0929f12d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6467225f-23c8-4800-b2c1-6dd0929f12d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1089ac1d-fa51-478f-b24b-58995dd1890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1089ac1d-fa51-478f-b24b-58995dd1890f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95', 'volume_name': 'volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ff0188-b977-457b-a9e2-817030481e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ff0188-b977-457b-a9e2-817030481e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a03f30-b72d-42ce-8f33-f46a91cd3e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Volume 30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95', 'volume_size': 1} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-137210701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e097f907f3c4e169e194705358409d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:30Z,use_quota=True,user_id='e235e81e69264826a16855bab40d6057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Creating volume 30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:29 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:09:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:29 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 1073741824 Sep 25 17:09:29 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:30 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 1073741824" returned: 0 in 0.669s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Flow 'volume_create_manager' (5bb95c63-e6ba-4501-b13e-6466710fe9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c76917-246d-4394-8d6b-b3cf364fb15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c76917-246d-4394-8d6b-b3cf364fb15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1273261399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1369c76c-987b-402e-8be0-0261207d1798,host='devstack@QuobyteHD#QuobyteHD',id=6ab04e54-a53a-4de5-adc9-f84b12cecfd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286954bf1fa84f98ae41a5ca284be1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:31Z,use_quota=True,user_id='521b198f2ed24e418a79d73fba1b2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5972552e-5aa4-47a2-81e4-7b913c57f577),volume_type_id=5972552e-5aa4-47a2-81e4-7b913c57f577)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e3fac9-4990-44e8-9a1f-b95433bce690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e3fac9-4990-44e8-9a1f-b95433bce690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e8ea75-fd76-47cf-9e68-34d60c725bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e8ea75-fd76-47cf-9e68-34d60c725bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab04e54-a53a-4de5-adc9-f84b12cecfd1', 'volume_name': 'volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c4ea8a-d5dd-4d79-b53d-e5cc6cf21482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c4ea8a-d5dd-4d79-b53d-e5cc6cf21482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4c1518-4464-4a23-bfb7-76a6878ecf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Volume 6ab04e54-a53a-4de5-adc9-f84b12cecfd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1', 'volume_size': 1} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:30 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 Sep 25 17:09:30 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:31 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" returned: 0 in 0.277s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1369c76c-987b-402e-8be0-0261207d1798,created_at=2026-09-25T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1273261399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1369c76c-987b-402e-8be0-0261207d1798,host='devstack@QuobyteHD#QuobyteHD',id=6ab04e54-a53a-4de5-adc9-f84b12cecfd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286954bf1fa84f98ae41a5ca284be1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:31Z,use_quota=True,user_id='521b198f2ed24e418a79d73fba1b2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5972552e-5aa4-47a2-81e4-7b913c57f577),volume_type_id=5972552e-5aa4-47a2-81e4-7b913c57f577)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Creating volume 6ab04e54-a53a-4de5-adc9-f84b12cecfd1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:31 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a03f30-b72d-42ce-8f33-f46a91cd3e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78efb51b-05c3-4ac0-9050-f672f5f70b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:31 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 1073741824 Sep 25 17:09:31 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Volume volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 (30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95): created successfully Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78efb51b-05c3-4ac0-9050-f672f5f70b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Flow 'volume_create_manager' (b0e92e60-4707-4a35-9040-2d590aed7679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a3475cba-d4be-432f-9bb4-ffeebd9d06f2 tempest-VolumesExtendTest-1238350284 None] Created volume successfully. Sep 25 17:09:31 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 1073741824" returned: 0 in 0.597s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=91,cinder:INSERT=32,cinder:DELETE=6,cinder:SELECT=94 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=102,cinder:SELECT=77,cinder:DELETE=5,cinder:INSERT=23 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:09:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:31 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 Sep 25 17:09:31 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:32 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4c1518-4464-4a23-bfb7-76a6878ecf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b5eff8-546d-4907-8c31-3e3e1ff78cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Volume volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 (6ab04e54-a53a-4de5-adc9-f84b12cecfd1): created successfully Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b5eff8-546d-4907-8c31-3e3e1ff78cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Flow 'volume_create_manager' (5bb95c63-e6ba-4501-b13e-6466710fe9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7b09b1c6-513e-4347-a135-92c935707246 tempest-GroupSnapshotsTest-533964219 None] Created volume successfully. Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Creating offline snapshot 596562b2-0d75-4ed7-8c43-67fe70905575 of volume 30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d062aca-b9fb-4157-b3f3-9f5489d78591]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:32 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 Sep 25 17:09:32 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:32 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" returned: 0 in 0.462s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:32 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 1G Sep 25 17:09:32 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:33 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 1G" returned: 0 in 0.519s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:33 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 Sep 25 17:09:33 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:33 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:33 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 is being set with open permissions: ugo+rw Sep 25 17:09:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:33 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 Sep 25 17:09:33 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:33 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Flow 'volume_create_manager' (386ccb81-abfd-4ba4-9180-db8f7fe8dd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e7e6de-727d-4d49-bcfd-2d11a96c7c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e7e6de-727d-4d49-bcfd-2d11a96c7c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1396308512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1369c76c-987b-402e-8be0-0261207d1798,host='devstack@QuobyteHD#QuobyteHD',id=f548cca5-177d-4b1f-9b53-656af3cfa8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286954bf1fa84f98ae41a5ca284be1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:34Z,use_quota=True,user_id='521b198f2ed24e418a79d73fba1b2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5972552e-5aa4-47a2-81e4-7b913c57f577),volume_type_id=5972552e-5aa4-47a2-81e4-7b913c57f577)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb13508-52c2-477f-bf82-89df520cc628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb13508-52c2-477f-bf82-89df520cc628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305c3df4-8493-4b30-ac5e-4bdc78875169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305c3df4-8493-4b30-ac5e-4bdc78875169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f548cca5-177d-4b1f-9b53-656af3cfa8bd', 'volume_name': 'volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8611fb02-4abd-450c-9525-850c0bf06b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8611fb02-4abd-450c-9525-850c0bf06b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12646f5-2dc8-40e7-b045-fd45865a9db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Volume f548cca5-177d-4b1f-9b53-656af3cfa8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd', 'volume_size': 1} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:34 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575" returned: 0 in 0.402s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:34 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.info Sep 25 17:09:34 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:34 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.info" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:34 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.info is being set with open permissions: ugo+rw Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:34 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.info Sep 25 17:09:34 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:34 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.info" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.666s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.887s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1369c76c-987b-402e-8be0-0261207d1798,created_at=2026-09-25T15:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1396308512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1369c76c-987b-402e-8be0-0261207d1798,host='devstack@QuobyteHD#QuobyteHD',id=f548cca5-177d-4b1f-9b53-656af3cfa8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286954bf1fa84f98ae41a5ca284be1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:34Z,use_quota=True,user_id='521b198f2ed24e418a79d73fba1b2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5972552e-5aa4-47a2-81e4-7b913c57f577),volume_type_id=5972552e-5aa4-47a2-81e4-7b913c57f577)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Creating volume f548cca5-177d-4b1f-9b53-656af3cfa8bd {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:34 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:09:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:34 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd 1073741824 Sep 25 17:09:34 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-087479b5-faad-4004-851f-ceacf26e67cd tempest-VolumesExtendTest-1238350284 None] Create snapshot completed successfully Sep 25 17:09:35 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd 1073741824" returned: 0 in 0.759s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3426c10-b3b0-45a1-a3b3-6bf3d874de5c tempest-VolumesExtendTest-1238350284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:35 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd Sep 25 17:09:35 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:36 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd" returned: 0 in 0.331s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3426c10-b3b0-45a1-a3b3-6bf3d874de5c tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.409s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12646f5-2dc8-40e7-b045-fd45865a9db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd2cd1b-4465-48c1-baaa-a2f560beb6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c55f91c-cb41-4bb0-ad67-c45a43d4ab64]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3426c10-b3b0-45a1-a3b3-6bf3d874de5c tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Volume volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd (f548cca5-177d-4b1f-9b53-656af3cfa8bd): created successfully Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd2cd1b-4465-48c1-baaa-a2f560beb6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Flow 'volume_create_manager' (386ccb81-abfd-4ba4-9180-db8f7fe8dd9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bc933b7c-b8c8-43c6-87f3-e552c41402d1 tempest-GroupSnapshotsTest-533964219 None] Created volume successfully. Sep 25 17:09:36 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 Sep 25 17:09:36 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:36 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e0efd26a-4aa0-4a0c-862a-c4e96ad0aca2 tempest-GroupSnapshotsTest-533964219 None] Update group completed successfully. Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3426c10-b3b0-45a1-a3b3-6bf3d874de5c tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" returned: 0 in 0.564s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3426c10-b3b0-45a1-a3b3-6bf3d874de5c tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 2G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a3426c10-b3b0-45a1-a3b3-6bf3d874de5c tempest-VolumesExtendTest-1238350284 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 2G" returned: 0 in 0.245s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a3426c10-b3b0-45a1-a3b3-6bf3d874de5c tempest-VolumesExtendTest-1238350284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.872s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a3426c10-b3b0-45a1-a3b3-6bf3d874de5c tempest-VolumesExtendTest-1238350284 None] Extend volume completed successfully. Sep 25 17:09:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8a4d28ec-ad22-4e87-afdb-122828720751 tempest-GroupSnapshotsTest-533964219 None] Update group completed successfully. Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Acquiring lock "cinder-596562b2-0d75-4ed7-8c43-67fe70905575-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Lock "cinder-596562b2-0d75-4ed7-8c43-67fe70905575-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Acquiring lock "cinder-quobyte-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Lock "cinder-quobyte-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Acquiring lock "cinder-quobyte-596562b2-0d75-4ed7-8c43-67fe70905575" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Lock "cinder-quobyte-596562b2-0d75-4ed7-8c43-67fe70905575" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Deleting offline snapshot 596562b2-0d75-4ed7-8c43-67fe70905575 of volume 30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] snapshot_file for this snap is: volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78ee5b7-8bd5-451c-82bb-d916401651f7]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:38 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 Sep 25 17:09:38 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Flow 'volume_create_manager' (79ef4784-d377-4481-b02e-0adbb8f9ae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79e67de-ec59-43eb-b687-99b7c20be769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79e67de-ec59-43eb-b687-99b7c20be769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-169773454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbb50bb-555c-4fb5-9010-61ec13058b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da94cc69479c408ca6e2ec80ad2e813a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:39Z,use_quota=True,user_id='1634b50dd6b0418aadb5170a21ef0726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49402662-275d-47e0-a2d1-7322feca34b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49402662-275d-47e0-a2d1-7322feca34b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78706009-dfff-4160-8847-029685c352d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78706009-dfff-4160-8847-029685c352d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cbb50bb-555c-4fb5-9010-61ec13058b94', 'volume_name': 'volume-9cbb50bb-555c-4fb5-9010-61ec13058b94', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b919605-c85a-4385-9b9d-146ee19d62dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b919605-c85a-4385-9b9d-146ee19d62dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29656d34-5918-4192-819b-b3e6ef8c60a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Volume 9cbb50bb-555c-4fb5-9010-61ec13058b94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cbb50bb-555c-4fb5-9010-61ec13058b94', 'volume_size': 1} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-169773454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbb50bb-555c-4fb5-9010-61ec13058b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da94cc69479c408ca6e2ec80ad2e813a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:39Z,use_quota=True,user_id='1634b50dd6b0418aadb5170a21ef0726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Creating volume 9cbb50bb-555c-4fb5-9010-61ec13058b94 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:38 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:38 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575" returned: 0 in 0.590s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:09:38 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 1073741824 Sep 25 17:09:38 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe706ae-185e-4f80-8629-637df4d72add]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:39 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 Sep 25 17:09:39 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-aee1723f-732a-4019-a14c-38e5714a9966 tempest-GroupSnapshotsTest-533964219 None] Update group completed successfully. Sep 25 17:09:39 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" returned: 0 in 0.545s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 1073741824" returned: 0 in 0.645s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:39 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:39 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 Sep 25 17:09:39 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:39 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 Sep 25 17:09:39 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:39 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29656d34-5918-4192-819b-b3e6ef8c60a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbb50bb-555c-4fb5-9010-61ec13058b94', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb30bdeb-a114-4c80-b4e7-7c8ee8b2547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Volume volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 (9cbb50bb-555c-4fb5-9010-61ec13058b94): created successfully Sep 25 17:09:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb30bdeb-a114-4c80-b4e7-7c8ee8b2547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Flow 'volume_create_manager' (79ef4784-d377-4481-b02e-0adbb8f9ae95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-858e2bea-e9d6-440d-90d3-ae26c1f07fe6 tempest-AttachVolumeNegativeTest-2013442506 None] Created volume successfully. Sep 25 17:09:40 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575" returned: 0 in 0.653s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:40 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575 Sep 25 17:09:40 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-91353e43-bc8f-48df-9163-efef6d9c1382 tempest-GroupSnapshotsTest-533964219 None] Update group completed successfully. Sep 25 17:09:40 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95.596562b2-0d75-4ed7-8c43-67fe70905575" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Lock "cinder-quobyte-596562b2-0d75-4ed7-8c43-67fe70905575" released by "_delete_snapshot" :: held 2.268s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Lock "cinder-quobyte-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" released by "delete_snapshot" :: held 2.310s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:40 devstack cinder-volume[87232]: WARNING cinder.quota [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:09:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Created reservations ['63cadee2-a06f-4fb3-8a1f-cf41a39b2a4d', 'e6448cc5-ef27-42c8-9706-93f0436d1b81', '07e9f60e-50ac-4bcf-afcf-0f9839b986c3', '4ef47c2b-5629-4da9-a6ee-5fe5b5650ad7'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Delete snapshot completed successfully. Sep 25 17:09:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2b81ad8e-92bf-449a-afde-3e8fc2a1ab16 tempest-VolumesExtendTest-1238350284 None] Lock "cinder-596562b2-0d75-4ed7-8c43-67fe70905575-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Acquiring lock "cinder-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Lock "cinder-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Acquiring lock "cinder-quobyte-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Lock "cinder-quobyte-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[974d4e52-1473-4d89-903a-57d192dace21]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] GroupSnapshot f42ba6d8-5b6f-456b-a2c7-b277d05fc638: creating. Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Group snapshot f42ba6d8-5b6f-456b-a2c7-b277d05fc638: creating. {{(pid=87232) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Creating offline snapshot 2a33a223-2ca0-4a3d-a235-bbf9456006b4 of volume 6ab04e54-a53a-4de5-adc9-f84b12cecfd1 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47a8210-c672-4303-9c59-1efe7593c59a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:42 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 Sep 25 17:09:42 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-ac7080b2-3e63-4b48-aac7-0e67eb561587 req-2d3860bd-7aaa-4d98-aa04-224b0c224793 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:42 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 Sep 25 17:09:42 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:42 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" returned: 0 in 0.678s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:42 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95 Sep 25 17:09:42 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:43 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" returned: 0 in 0.743s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:43 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 1G Sep 25 17:09:43 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:43 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" returned: 0 in 0.447s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Lock "cinder-quobyte-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95" released by "delete_volume" :: held 1.254s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Created reservations ['01e490b6-4738-4ee6-afea-717205dab08d', '57f89350-3e0c-482e-a05d-7776a39de7ab', 'df59017e-92be-4de6-91f0-af5c64aa2682', 'c68f2a44-e129-4566-9297-e39dc0705ea0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:43 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:09:43 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:43 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 1G" returned: 0 in 0.597s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:43 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 Sep 25 17:09:43 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:43 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:43 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Deleted volume successfully. Sep 25 17:09:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9d439940-425e-41b7-8c53-80f64e96678f tempest-VolumesExtendTest-1238350284 None] Lock "cinder-30d8b37f-8ac7-4ec8-90f6-7826b2c0ab95-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:44 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4" returned: 0 in 0.380s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:44 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:09:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:44 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 Sep 25 17:09:44 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:44 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4" returned: 0 in 0.446s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:44 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.info Sep 25 17:09:44 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:45 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.info" returned: 0 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:45 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:09:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:45 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.info Sep 25 17:09:45 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:45 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.info" returned: 0 in 0.391s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Creating offline snapshot 5782ef3a-5734-4a5c-a449-94cc73c4d819 of volume f548cca5-177d-4b1f-9b53-656af3cfa8bd {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:09:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9468f03-e302-48ba-85f9-6cb8bcc2d313]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:45 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd Sep 25 17:09:45 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:46 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd" returned: 0 in 0.528s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:46 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 1G Sep 25 17:09:46 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:46 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 1G" returned: 0 in 0.691s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:46 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 Sep 25 17:09:46 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:47 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819" returned: 0 in 0.478s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:47 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:09:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:47 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 Sep 25 17:09:47 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:47 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819" returned: 0 in 0.425s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:47 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.info Sep 25 17:09:47 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:48 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.info" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:48 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:09:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:48 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.info Sep 25 17:09:48 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:48 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.info" returned: 0 in 0.363s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.965s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-ac7080b2-3e63-4b48-aac7-0e67eb561587 req-2d3860bd-7aaa-4d98-aa04-224b0c224793 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.943s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-ac7080b2-3e63-4b48-aac7-0e67eb561587 req-2d3860bd-7aaa-4d98-aa04-224b0c224793 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-ac7080b2-3e63-4b48-aac7-0e67eb561587 req-2d3860bd-7aaa-4d98-aa04-224b0c224793 tempest-AttachVolumeNegativeTest-2013442506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-9cbb50bb-555c-4fb5-9010-61ec13058b94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f110b569-5519-4985-b989-2fab6985710a', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:09:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-ac7080b2-3e63-4b48-aac7-0e67eb561587 req-2d3860bd-7aaa-4d98-aa04-224b0c224793 tempest-AttachVolumeNegativeTest-2013442506 None] attachment_update completed successfully. Sep 25 17:09:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ebe08be7-d3de-4253-95bc-b667ea620b8f tempest-GroupSnapshotsTest-533964219 None] group_snapshot f42ba6d8-5b6f-456b-a2c7-b277d05fc638: created successfully Sep 25 17:09:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] group_snapshot f42ba6d8-5b6f-456b-a2c7-b277d05fc638: deleting Sep 25 17:09:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] group_snapshot f42ba6d8-5b6f-456b-a2c7-b277d05fc638: deleting {{(pid=87232) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:09:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-2a33a223-2ca0-4a3d-a235-bbf9456006b4" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-2a33a223-2ca0-4a3d-a235-bbf9456006b4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Deleting offline snapshot 2a33a223-2ca0-4a3d-a235-bbf9456006b4 of volume 6ab04e54-a53a-4de5-adc9-f84b12cecfd1 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:09:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] snapshot_file for this snap is: volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:09:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[035761ad-5695-453c-a431-892f1fc5119a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:49 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 Sep 25 17:09:49 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:50 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4" returned: 0 in 0.628s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:09:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[254b176c-3000-43a7-93c8-fe4cf8907f31]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:50 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 Sep 25 17:09:50 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:50 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" returned: 0 in 0.509s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:50 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 Sep 25 17:09:50 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Flow 'volume_create_manager' (7d70f409-e74b-4c2c-9005-4d0d2baee5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42174198-2b5f-4921-97e8-80de4c1bc4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:51 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42174198-2b5f-4921-97e8-80de4c1bc4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1360580283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1629b89f-d8b5-4662-bb7b-b842fa2e40f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51034a208584104b8466da9a6bad48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:51Z,use_quota=True,user_id='1c6e3038b4d149dbb130ebb0bf98d77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae3465d-6edb-47a7-abcb-b3571ff1e1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae3465d-6edb-47a7-abcb-b3571ff1e1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966b89be-99a2-4d8b-8a02-25af3cbaee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966b89be-99a2-4d8b-8a02-25af3cbaee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1629b89f-d8b5-4662-bb7b-b842fa2e40f9', 'volume_name': 'volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dfbba4-9839-4fc2-9317-ef4e2d073cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dfbba4-9839-4fc2-9317-ef4e2d073cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db12e48-42be-479d-b6ad-e50554a2ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Volume 1629b89f-d8b5-4662-bb7b-b842fa2e40f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9', 'volume_size': 1} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1360580283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1629b89f-d8b5-4662-bb7b-b842fa2e40f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51034a208584104b8466da9a6bad48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:51Z,use_quota=True,user_id='1c6e3038b4d149dbb130ebb0bf98d77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Creating volume 1629b89f-d8b5-4662-bb7b-b842fa2e40f9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:51 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4" returned: 0 in 0.591s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:51 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 1073741824 Sep 25 17:09:51 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:51 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4 Sep 25 17:09:51 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:51 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1.2a33a223-2ca0-4a3d-a235-bbf9456006b4" returned: 0 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-2a33a223-2ca0-4a3d-a235-bbf9456006b4" released by "_delete_snapshot" :: held 2.296s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" released by "delete_snapshot" :: held 2.342s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-f548cca5-177d-4b1f-9b53-656af3cfa8bd" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-f548cca5-177d-4b1f-9b53-656af3cfa8bd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-5782ef3a-5734-4a5c-a449-94cc73c4d819" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-5782ef3a-5734-4a5c-a449-94cc73c4d819" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Deleting offline snapshot 5782ef3a-5734-4a5c-a449-94cc73c4d819 of volume f548cca5-177d-4b1f-9b53-656af3cfa8bd {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] snapshot_file for this snap is: volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[799172fa-9acc-4488-9925-c0ba64fd6cf1]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:52 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 1073741824" returned: 0 in 0.789s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:52 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 Sep 25 17:09:52 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:52 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 Sep 25 17:09:52 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:52 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db12e48-42be-479d-b6ad-e50554a2ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a372d253-62b7-4ede-a750-037d29222d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:52 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Volume volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 (1629b89f-d8b5-4662-bb7b-b842fa2e40f9): created successfully Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a372d253-62b7-4ede-a750-037d29222d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Flow 'volume_create_manager' (7d70f409-e74b-4c2c-9005-4d0d2baee5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:52 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-16891359-bc3c-40d8-b0c0-f9e08b1ccc89 tempest-VolumesListTestJSON-748593335 None] Created volume successfully. Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819" returned: 0 in 0.677s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b92e20b-6288-4227-8a70-f29dc0e46e08]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-2f197cfb-a232-4ade-ae29-bcb1b04d3d8e req-1adc10d3-36ee-4ba1-b4e0-481a4900f29e tempest-AttachVolumeNegativeTest-2013442506 None] Terminate volume connection completed successfully. Sep 25 17:09:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-2f197cfb-a232-4ade-ae29-bcb1b04d3d8e req-1adc10d3-36ee-4ba1-b4e0-481a4900f29e tempest-AttachVolumeNegativeTest-2013442506 None] Deleting attachment f110b569-5519-4985-b989-2fab6985710a. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:09:52 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd Sep 25 17:09:52 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:52 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd" returned: 0 in 0.460s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:53 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 Sep 25 17:09:53 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:53 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819" returned: 0 in 0.901s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:54 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819 Sep 25 17:09:54 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:54 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd.5782ef3a-5734-4a5c-a449-94cc73c4d819" returned: 0 in 0.631s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-5782ef3a-5734-4a5c-a449-94cc73c4d819" released by "_delete_snapshot" :: held 2.889s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-f548cca5-177d-4b1f-9b53-656af3cfa8bd" released by "delete_snapshot" :: held 2.937s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Flow 'volume_create_manager' (a90e0b4c-f19a-44b3-9138-6e5f62e18bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210350dd-1945-4201-8789-d25721975319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210350dd-1945-4201-8789-d25721975319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1542223294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c486ea2c-0296-4860-83dd-5e2b73140edd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51034a208584104b8466da9a6bad48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:55Z,use_quota=True,user_id='1c6e3038b4d149dbb130ebb0bf98d77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2918d76e-bc94-468d-abf8-674973359f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2918d76e-bc94-468d-abf8-674973359f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74f49fa-b257-448e-a270-2e517ce64aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74f49fa-b257-448e-a270-2e517ce64aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c486ea2c-0296-4860-83dd-5e2b73140edd', 'volume_name': 'volume-c486ea2c-0296-4860-83dd-5e2b73140edd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5847384-3c45-49e3-bae7-946e4b86e335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5847384-3c45-49e3-bae7-946e4b86e335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6364d750-648c-4adc-b95d-5b529f011132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:54 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Volume c486ea2c-0296-4860-83dd-5e2b73140edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c486ea2c-0296-4860-83dd-5e2b73140edd', 'volume_size': 1} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1542223294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c486ea2c-0296-4860-83dd-5e2b73140edd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51034a208584104b8466da9a6bad48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:55Z,use_quota=True,user_id='1c6e3038b4d149dbb130ebb0bf98d77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Creating volume c486ea2c-0296-4860-83dd-5e2b73140edd {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:55 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:09:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:55 devstack cinder-volume[87232]: WARNING cinder.quota [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1180513901 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1180513901, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:09:55 devstack cinder-volume[87232]: WARNING cinder.quota [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1180513901 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1180513901, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:09:55 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd 1073741824 Sep 25 17:09:55 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Created reservations ['8bedaef5-fd42-44be-baaa-fe9d11808610', 'bb5bc698-c2b3-4521-acfd-c063d14b5b1b', 'bbe208b1-be9b-4d1f-aa4b-59ea8e7eccfa', '7667ff80-432b-43d1-b4b3-49aaa853971f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] Created reservations ['28f2b3e7-fd39-47b6-abf4-41e096f6234a', '2561cb37-d3fa-42a2-9d1d-f39731596288', 'cf4e6d43-6104-411b-a105-3185cb7cd6fd', 'c8e44875-6885-4667-b80f-0644ca9a2595'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-03a0ed68-e269-4a5e-924b-3f5fc6934fed tempest-GroupSnapshotsTest-533964219 None] group_snapshot f42ba6d8-5b6f-456b-a2c7-b277d05fc638: deleted successfully Sep 25 17:09:55 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd 1073741824" returned: 0 in 0.907s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:56 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd Sep 25 17:09:56 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:56 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:09:56 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:56 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd" returned: 0 in 0.400s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6364d750-648c-4adc-b95d-5b529f011132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c486ea2c-0296-4860-83dd-5e2b73140edd', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d492e26f-f21b-4503-8d8f-6dab4da55fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Volume volume-c486ea2c-0296-4860-83dd-5e2b73140edd (c486ea2c-0296-4860-83dd-5e2b73140edd): created successfully Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d492e26f-f21b-4503-8d8f-6dab4da55fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Flow 'volume_create_manager' (a90e0b4c-f19a-44b3-9138-6e5f62e18bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a6ae7185-70a5-4ba2-9b52-5d587420ea7c tempest-VolumesListTestJSON-748593335 None] Created volume successfully. Sep 25 17:09:56 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[31973510-378d-4dc2-9725-74cbf73b5912]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:57 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 Sep 25 17:09:57 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Flow 'volume_create_manager' (4b041910-6e6e-4b49-98fe-d027f251e661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04436128-d16e-4104-b9a8-1e89bdd629d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04436128-d16e-4104-b9a8-1e89bdd629d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-153577410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a59d834-720a-40fc-a182-4a9f069385ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51034a208584104b8466da9a6bad48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:57Z,use_quota=True,user_id='1c6e3038b4d149dbb130ebb0bf98d77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e366d6-080b-4b8d-8214-546a6b56bb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e366d6-080b-4b8d-8214-546a6b56bb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9704809-eeb4-4727-aa69-5dba7a495e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9704809-eeb4-4727-aa69-5dba7a495e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a59d834-720a-40fc-a182-4a9f069385ba', 'volume_name': 'volume-4a59d834-720a-40fc-a182-4a9f069385ba', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cbc4c7-2a12-44a4-9816-4e96ad614e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cbc4c7-2a12-44a4-9816-4e96ad614e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdfd544-1273-4ab5-ad21-46bc98592214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Volume 4a59d834-720a-40fc-a182-4a9f069385ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a59d834-720a-40fc-a182-4a9f069385ba', 'volume_size': 1} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-153577410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a59d834-720a-40fc-a182-4a9f069385ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d51034a208584104b8466da9a6bad48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:09:57Z,use_quota=True,user_id='1c6e3038b4d149dbb130ebb0bf98d77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Creating volume 4a59d834-720a-40fc-a182-4a9f069385ba {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:09:57 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:57 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:57 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba 1073741824 Sep 25 17:09:57 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:57 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1 Sep 25 17:09:57 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:57 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-6ab04e54-a53a-4de5-adc9-f84b12cecfd1" released by "delete_volume" :: held 0.921s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-f548cca5-177d-4b1f-9b53-656af3cfa8bd" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-f548cca5-177d-4b1f-9b53-656af3cfa8bd" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b80470-eb60-4f91-ad55-3c3f3e03bc52]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:09:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:58 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba 1073741824" returned: 0 in 0.529s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:58 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd Sep 25 17:09:58 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:58 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba Sep 25 17:09:58 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:58 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:58 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd" returned: 0 in 0.493s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba" returned: 0 in 0.346s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:58 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd Sep 25 17:09:58 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdfd544-1273-4ab5-ad21-46bc98592214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a59d834-720a-40fc-a182-4a9f069385ba', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c29020c-7e53-465a-9d4b-9df187560fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:09:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Volume volume-4a59d834-720a-40fc-a182-4a9f069385ba (4a59d834-720a-40fc-a182-4a9f069385ba): created successfully Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c29020c-7e53-465a-9d4b-9df187560fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Flow 'volume_create_manager' (4b041910-6e6e-4b49-98fe-d027f251e661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:09:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d028599a-e757-456a-a12e-61e24a4eab61 tempest-VolumesListTestJSON-748593335 None] Created volume successfully. Sep 25 17:09:58 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f548cca5-177d-4b1f-9b53-656af3cfa8bd" returned: 0 in 0.296s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-f548cca5-177d-4b1f-9b53-656af3cfa8bd" released by "delete_volume" :: held 0.865s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Created reservations ['a53df33f-47a6-480f-8290-5a127655fdfb'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:58 devstack cinder-volume[87232]: WARNING cinder.quota [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1180513901 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1180513901, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Created reservations ['41478621-91dd-4faa-89dd-056173643ff2', '6b704a18-ec82-484e-893d-fbad2ad54a19', '25affc90-377b-4be6-a6ef-25f4e972250b', 'fd41c8f9-adec-49c4-9842-86c1b79362a1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Created reservations ['0429ee63-a3c9-48e0-8c60-8d3b10a0f099', '1e4af17a-30c0-4614-8495-d753922e6495', 'a0aa9b8c-96f3-4c64-baa8-5812494861df', '909aee2f-38c8-4344-9616-115cd2440823'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:09:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:09:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:09:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:09:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:09:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:09:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:09:59 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:09:59 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:09:59 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 25 17:09:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:09:59 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:09:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c7e3d6f5-9a18-424a-814d-f61bb39d96d8 tempest-GroupSnapshotsTest-533964219 None] Delete group completed successfully. Sep 25 17:10:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a5a31ae6-21b7-4192-890b-645cd70583d4 tempest-GroupSnapshotsTest-533964219 None] Group tempest-GroupSnapshotsTest-Group-1017682464: creating Sep 25 17:10:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a5a31ae6-21b7-4192-890b-645cd70583d4 tempest-GroupSnapshotsTest-533964219 None] Group tempest-GroupSnapshotsTest-Group-1017682464: created successfully Sep 25 17:10:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a5a31ae6-21b7-4192-890b-645cd70583d4 tempest-GroupSnapshotsTest-533964219 None] Create group completed successfully. Sep 25 17:10:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "cinder-4a59d834-720a-40fc-a182-4a9f069385ba-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Lock "cinder-4a59d834-720a-40fc-a182-4a9f069385ba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "cinder-quobyte-4a59d834-720a-40fc-a182-4a9f069385ba" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Lock "cinder-quobyte-4a59d834-720a-40fc-a182-4a9f069385ba" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb89466-a98c-4cb7-8fec-09c37433930e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Flow 'volume_create_manager' (0c28d1c4-e996-4adf-b538-b7acebd78d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:02 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba Sep 25 17:10:02 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0778d530-46d5-43be-bdf9-a04e33294e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0778d530-46d5-43be-bdf9-a04e33294e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1204519875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb7e97cc-0da0-4596-a39b-bbc972dd8edf,host='devstack@QuobyteHD#QuobyteHD',id=0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286954bf1fa84f98ae41a5ca284be1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:02Z,use_quota=True,user_id='521b198f2ed24e418a79d73fba1b2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dae0139-4260-4fee-8534-58b2d5445596),volume_type_id=2dae0139-4260-4fee-8534-58b2d5445596)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ebf2a5-7a56-4708-9b18-ad7d15b9c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ebf2a5-7a56-4708-9b18-ad7d15b9c73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b8f51f-eeab-4bb3-9acd-01768e7f63a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b8f51f-eeab-4bb3-9acd-01768e7f63a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e', 'volume_name': 'volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71300e69-22b5-4a1a-b1e2-d5361513617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71300e69-22b5-4a1a-b1e2-d5361513617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba7dbc3-1c9c-41e1-8b48-ed09d174de29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Volume 0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e', 'volume_size': 1} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb7e97cc-0da0-4596-a39b-bbc972dd8edf,created_at=2026-09-25T15:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1204519875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb7e97cc-0da0-4596-a39b-bbc972dd8edf,host='devstack@QuobyteHD#QuobyteHD',id=0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286954bf1fa84f98ae41a5ca284be1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:02Z,use_quota=True,user_id='521b198f2ed24e418a79d73fba1b2a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dae0139-4260-4fee-8534-58b2d5445596),volume_type_id=2dae0139-4260-4fee-8534-58b2d5445596)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Creating volume 0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:02 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:02 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e 1073741824 Sep 25 17:10:02 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:02 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba" returned: 0 in 0.532s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:02 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba Sep 25 17:10:02 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:02 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4a59d834-720a-40fc-a182-4a9f069385ba" returned: 0 in 0.414s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Lock "cinder-quobyte-4a59d834-720a-40fc-a182-4a9f069385ba" released by "delete_volume" :: held 1.061s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:02 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e 1073741824" returned: 0 in 0.790s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Created reservations ['b48d07e3-8eb7-4d61-9134-da5196fbf070', '6a549a51-ccfa-432c-83bb-216343557c6b', '1797a112-f9bf-4d3d-a60e-ae774aeef979', '4a4ede65-7990-4d6f-acff-5ec31ea56c69'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:03 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e Sep 25 17:10:03 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:03 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:03 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:03 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" returned: 0 in 0.449s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba7dbc3-1c9c-41e1-8b48-ed09d174de29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02b6d4b-d1bf-4482-88b9-144dbc617ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:03 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.429s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Volume volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e (0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e): created successfully Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02b6d4b-d1bf-4482-88b9-144dbc617ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Flow 'volume_create_manager' (0c28d1c4-e996-4adf-b538-b7acebd78d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Deleted volume successfully. Sep 25 17:10:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cca4ac4b-5368-4259-a8b5-8fdc96315161 tempest-GroupSnapshotsTest-533964219 None] Created volume successfully. Sep 25 17:10:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ac7e1b23-5d0c-46c5-a026-ed5d301ead61 tempest-VolumesListTestJSON-748593335 None] Lock "cinder-4a59d834-720a-40fc-a182-4a9f069385ba-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "cinder-c486ea2c-0296-4860-83dd-5e2b73140edd-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Lock "cinder-c486ea2c-0296-4860-83dd-5e2b73140edd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "cinder-quobyte-c486ea2c-0296-4860-83dd-5e2b73140edd" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Lock "cinder-quobyte-c486ea2c-0296-4860-83dd-5e2b73140edd" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e72a3f-431f-4bca-92bb-57816c2bcb20]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:04 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd Sep 25 17:10:04 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] GroupSnapshot 75ef0bdf-ee21-4e08-b96c-845ac8d9fd4d: creating. Sep 25 17:10:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Group snapshot 75ef0bdf-ee21-4e08-b96c-845ac8d9fd4d: creating. {{(pid=87232) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:10:04 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd" returned: 0 in 0.670s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Creating offline snapshot 52c65749-a067-459d-a25f-9d9995d80f6c of volume 0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:10:05 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd Sep 25 17:10:05 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f59a3b8-cc25-4447-8c1e-8885ebc553ee]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:05 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e Sep 25 17:10:05 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:05 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c486ea2c-0296-4860-83dd-5e2b73140edd" returned: 0 in 0.328s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Lock "cinder-quobyte-c486ea2c-0296-4860-83dd-5e2b73140edd" released by "delete_volume" :: held 1.065s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Created reservations ['cd4938d1-d6e6-4968-822f-7b7ec4614d5f', '3d4e584c-10fd-4024-aefd-b9f885702627', '19445065-e4c9-4c26-a223-e9910ac4264e', '404201a4-c267-4358-bb26-7b42e490b755'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:05 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" returned: 0 in 0.466s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:05 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:05 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:05 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c 1G Sep 25 17:10:05 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:05 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Deleted volume successfully. Sep 25 17:10:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-530e47e1-3a31-4f31-a702-c975bff2e880 tempest-VolumesListTestJSON-748593335 None] Lock "cinder-c486ea2c-0296-4860-83dd-5e2b73140edd-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:06 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c 1G" returned: 0 in 0.538s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:06 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c Sep 25 17:10:06 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:06 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:06 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:06 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c Sep 25 17:10:06 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Acquiring lock "cinder-1629b89f-d8b5-4662-bb7b-b842fa2e40f9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Lock "cinder-1629b89f-d8b5-4662-bb7b-b842fa2e40f9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Acquiring lock "cinder-quobyte-1629b89f-d8b5-4662-bb7b-b842fa2e40f9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Lock "cinder-quobyte-1629b89f-d8b5-4662-bb7b-b842fa2e40f9" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:06 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c" returned: 0 in 0.328s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[331349e2-56bf-4ff2-a028-f46d65d0c7d1]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:06 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.info Sep 25 17:10:06 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:06 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 Sep 25 17:10:06 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:07 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.info" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:07 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:07 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.info Sep 25 17:10:07 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:07 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9" returned: 0 in 0.500s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:07 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9 Sep 25 17:10:07 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:07 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.info" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4e437deb-5135-478b-8a9f-05ec492f13a3 tempest-GroupSnapshotsTest-533964219 None] group_snapshot 75ef0bdf-ee21-4e08-b96c-845ac8d9fd4d: created successfully Sep 25 17:10:07 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1629b89f-d8b5-4662-bb7b-b842fa2e40f9" returned: 0 in 0.552s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Lock "cinder-quobyte-1629b89f-d8b5-4662-bb7b-b842fa2e40f9" released by "delete_volume" :: held 1.129s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Flow 'volume_create_manager' (d85da8ae-f6b1-4abb-ab8c-6c91268a860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e423b05-f050-484c-bb73-af4bb9060b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Created reservations ['e8cf8128-5024-4865-8cca-1cdf4fbfef80', 'ac517935-d824-41e9-97f8-b308fea82fe1', '18e958b6-c9b5-4d30-8aea-586370491b5e', 'bf61cea0-c9c5-4c38-ab59-96cc92c82bd0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e423b05-f050-484c-bb73-af4bb9060b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-751936297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5aeb1f-bca9-4f22-b0fe-def353594069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef99fc08128b4f2f9f2963d654f3ba59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:08Z,use_quota=True,user_id='5850cbb657b04bcd963cbc21bfa6b4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c841174-4faf-4e27-9140-9c60f1c63b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c841174-4faf-4e27-9140-9c60f1c63b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed288d8-ac8d-418b-a17a-282a8cc40345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed288d8-ac8d-418b-a17a-282a8cc40345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5aeb1f-bca9-4f22-b0fe-def353594069', 'volume_name': 'volume-fe5aeb1f-bca9-4f22-b0fe-def353594069', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e4a15d-aa29-402e-b97f-eda792dbb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e4a15d-aa29-402e-b97f-eda792dbb601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4508f43a-a002-4947-8cf1-95622f0d802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Volume fe5aeb1f-bca9-4f22-b0fe-def353594069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5aeb1f-bca9-4f22-b0fe-def353594069', 'volume_size': 1} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-751936297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5aeb1f-bca9-4f22-b0fe-def353594069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef99fc08128b4f2f9f2963d654f3ba59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:08Z,use_quota=True,user_id='5850cbb657b04bcd963cbc21bfa6b4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Creating volume fe5aeb1f-bca9-4f22-b0fe-def353594069 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:08 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:08 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 1073741824 Sep 25 17:10:08 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:08 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:08 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] group_snapshot 75ef0bdf-ee21-4e08-b96c-845ac8d9fd4d: deleting Sep 25 17:10:08 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.456s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Deleted volume successfully. Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] group_snapshot 75ef0bdf-ee21-4e08-b96c-845ac8d9fd4d: deleting {{(pid=87232) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d053700-a75d-4fd8-b758-39760453ea4c tempest-VolumesListTestJSON-748593335 None] Lock "cinder-1629b89f-d8b5-4662-bb7b-b842fa2e40f9-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-52c65749-a067-459d-a25f-9d9995d80f6c" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-52c65749-a067-459d-a25f-9d9995d80f6c" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Deleting offline snapshot 52c65749-a067-459d-a25f-9d9995d80f6c of volume 0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] snapshot_file for this snap is: volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[81556203-549c-4b34-84d2-8d7c6689a40a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:09 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 1073741824" returned: 0 in 0.969s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:09 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 Sep 25 17:10:09 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:09 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c Sep 25 17:10:09 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:09 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069" returned: 0 in 0.565s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4508f43a-a002-4947-8cf1-95622f0d802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5aeb1f-bca9-4f22-b0fe-def353594069', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7099c013-749a-4d3d-a6c0-165f3f90579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:09 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c" returned: 0 in 0.813s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Volume volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 (fe5aeb1f-bca9-4f22-b0fe-def353594069): created successfully Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7099c013-749a-4d3d-a6c0-165f3f90579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Flow 'volume_create_manager' (d85da8ae-f6b1-4abb-ab8c-6c91268a860d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa56812-5e32-4fb8-8328-dad26ddab6a3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d725647d-12ce-4df7-908e-6ec48d99c493 tempest-AttachVolumeTestJSON-1650136813 None] Created volume successfully. Sep 25 17:10:09 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e Sep 25 17:10:09 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:10 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" returned: 0 in 0.715s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:10 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c Sep 25 17:10:10 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:11 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c" returned: 0 in 0.860s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:11 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c Sep 25 17:10:11 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-aaa49aa5-5e21-43d7-9ae1-e22ca07413aa req-5694fe9d-3538-4282-a4fb-0be6544d0955 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-aaa49aa5-5e21-43d7-9ae1-e22ca07413aa req-5694fe9d-3538-4282-a4fb-0be6544d0955 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-aaa49aa5-5e21-43d7-9ae1-e22ca07413aa req-5694fe9d-3538-4282-a4fb-0be6544d0955 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-aaa49aa5-5e21-43d7-9ae1-e22ca07413aa req-5694fe9d-3538-4282-a4fb-0be6544d0955 tempest-AttachVolumeTestJSON-1650136813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-fe5aeb1f-bca9-4f22-b0fe-def353594069', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a840ff24-32b5-4c3b-810c-b47837f29ab4', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:10:11 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e.52c65749-a067-459d-a25f-9d9995d80f6c" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-52c65749-a067-459d-a25f-9d9995d80f6c" released by "_delete_snapshot" :: held 3.153s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" released by "delete_snapshot" :: held 3.217s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-aaa49aa5-5e21-43d7-9ae1-e22ca07413aa req-5694fe9d-3538-4282-a4fb-0be6544d0955 tempest-AttachVolumeTestJSON-1650136813 None] attachment_update completed successfully. Sep 25 17:10:12 devstack cinder-volume[87232]: WARNING cinder.quota [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1402016992 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1402016992, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:10:12 devstack cinder-volume[87232]: WARNING cinder.quota [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1402016992 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1402016992, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:10:12 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] Created reservations ['6c7c8431-fb97-49cd-b518-31ec1e9859b8', '87ae08df-c2c1-44bf-b353-2983c41aa0b1', 'a3f1b439-f0e6-4f33-aac7-320d2d4b28c3', '833ce926-ca3d-48a3-bce1-7d523795a768'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-23c39c3c-3fd6-4236-8b88-845d1f2e56c8 tempest-GroupSnapshotsTest-533964219 None] group_snapshot 75ef0bdf-ee21-4e08-b96c-845ac8d9fd4d: deleted successfully Sep 25 17:10:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "cinder-quobyte-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[900548a5-b540-4888-a55e-adf2083290f6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:13 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e Sep 25 17:10:13 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:14 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" returned: 0 in 0.798s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:14 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e Sep 25 17:10:14 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:14 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Lock "cinder-quobyte-0c29ab09-0edf-4b2e-8ddc-b217dbfcc21e" released by "delete_volume" :: held 1.270s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:14 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Created reservations ['cbbc5c98-6582-491c-9d62-56430295a413'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:14 devstack cinder-volume[87232]: WARNING cinder.quota [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1402016992 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1402016992, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:10:14 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Created reservations ['708133e3-2406-4656-b698-65756597c336', '7299afd7-8803-40be-ac1b-b3b9134db9e4', '80cdd611-2812-46d4-a76f-d95d10470c68', '64da72d6-515d-4281-bc10-12d472733d99'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:15 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:15 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:15 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.432s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:15 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-29e82c88-c146-4c00-87b3-2d73aa709ae7 tempest-GroupSnapshotsTest-533964219 None] Delete group completed successfully. Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Flow 'volume_create_manager' (fd743fef-a480-4f2d-8a51-dc8e37e57bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8307b73a-bf39-4108-9f70-09e1c52f92fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8307b73a-bf39-4108-9f70-09e1c52f92fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1916308961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48676107-de8d-45b0-9be9-a9048d12a815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef99fc08128b4f2f9f2963d654f3ba59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:16Z,use_quota=True,user_id='5850cbb657b04bcd963cbc21bfa6b4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef7dee6-b314-4358-8285-efdbee7ac69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef7dee6-b314-4358-8285-efdbee7ac69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b5966-636f-4a2b-82c1-e04b43085385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b5966-636f-4a2b-82c1-e04b43085385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48676107-de8d-45b0-9be9-a9048d12a815', 'volume_name': 'volume-48676107-de8d-45b0-9be9-a9048d12a815', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814972f6-f92b-4f97-91fc-5231c1bcd5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814972f6-f92b-4f97-91fc-5231c1bcd5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d234717b-d4e6-4cb9-8fee-45e5d752fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Volume 48676107-de8d-45b0-9be9-a9048d12a815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48676107-de8d-45b0-9be9-a9048d12a815', 'volume_size': 1} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1916308961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48676107-de8d-45b0-9be9-a9048d12a815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef99fc08128b4f2f9f2963d654f3ba59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:16Z,use_quota=True,user_id='5850cbb657b04bcd963cbc21bfa6b4e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Creating volume 48676107-de8d-45b0-9be9-a9048d12a815 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:16 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:16 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815 1073741824 Sep 25 17:10:16 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Flow 'volume_create_manager' (900f02a6-33f8-4d61-87c3-b0bc1f0a4d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc45f0f1-e5ae-4b60-93da-b1581e54a3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc45f0f1-e5ae-4b60-93da-b1581e54a3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1607273448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16df0710-b1bb-4442-a1e0-d25e54efbaab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a692b97db44b9884cc302b419c7c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:16Z,use_quota=True,user_id='414697ef167042d2b385337fd910ead3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a87809-1037-4c88-90fb-a1c229d30691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a87809-1037-4c88-90fb-a1c229d30691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf7f9ea-bebf-4283-bf58-32a5b4da8c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf7f9ea-bebf-4283-bf58-32a5b4da8c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16df0710-b1bb-4442-a1e0-d25e54efbaab', 'volume_name': 'volume-16df0710-b1bb-4442-a1e0-d25e54efbaab', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8627ab-fe01-43fb-9929-2820a6bc92d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8627ab-fe01-43fb-9929-2820a6bc92d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ea79dc-1a11-47f5-b0a8-cacbb1c14502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Volume 16df0710-b1bb-4442-a1e0-d25e54efbaab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16df0710-b1bb-4442-a1e0-d25e54efbaab', 'volume_size': 1} Sep 25 17:10:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:17 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815 1073741824" returned: 0 in 0.749s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:17 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815 Sep 25 17:10:17 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:17 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.920s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1607273448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16df0710-b1bb-4442-a1e0-d25e54efbaab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17a692b97db44b9884cc302b419c7c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:16Z,use_quota=True,user_id='414697ef167042d2b385337fd910ead3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Creating volume 16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:17 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:17 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab 1073741824 Sep 25 17:10:17 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d234717b-d4e6-4cb9-8fee-45e5d752fef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48676107-de8d-45b0-9be9-a9048d12a815', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c773ab-ee6c-4745-9ddf-e386ce90ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Volume volume-48676107-de8d-45b0-9be9-a9048d12a815 (48676107-de8d-45b0-9be9-a9048d12a815): created successfully Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c773ab-ee6c-4745-9ddf-e386ce90ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Flow 'volume_create_manager' (fd743fef-a480-4f2d-8a51-dc8e37e57bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dd4a19c0-fc8d-4ac4-8b28-b430c611bf31 tempest-AttachVolumeTestJSON-1650136813 None] Created volume successfully. Sep 25 17:10:18 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab 1073741824" returned: 0 in 0.632s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:18 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab Sep 25 17:10:18 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:18 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab" returned: 0 in 0.488s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ea79dc-1a11-47f5-b0a8-cacbb1c14502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16df0710-b1bb-4442-a1e0-d25e54efbaab', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa4df1f-d3cd-4204-821d-814aac44c4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Volume volume-16df0710-b1bb-4442-a1e0-d25e54efbaab (16df0710-b1bb-4442-a1e0-d25e54efbaab): created successfully Sep 25 17:10:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa4df1f-d3cd-4204-821d-814aac44c4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Flow 'volume_create_manager' (900f02a6-33f8-4d61-87c3-b0bc1f0a4d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ff574303-bc3c-40cf-ba03-9b7b23f70521 tempest-VolumesSnapshotListTestJSON-22035017 None] Created volume successfully. Sep 25 17:10:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-29062a0e-7aca-47e4-9074-a642083d9c4b req-c75e9f9c-d5c6-4396-92d5-cb457702b7a0 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-29062a0e-7aca-47e4-9074-a642083d9c4b req-c75e9f9c-d5c6-4396-92d5-cb457702b7a0 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-29062a0e-7aca-47e4-9074-a642083d9c4b req-c75e9f9c-d5c6-4396-92d5-cb457702b7a0 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-29062a0e-7aca-47e4-9074-a642083d9c4b req-c75e9f9c-d5c6-4396-92d5-cb457702b7a0 tempest-AttachVolumeTestJSON-1650136813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-48676107-de8d-45b0-9be9-a9048d12a815', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f904a426-d625-4d19-940d-7bef4f3db22f', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:10:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-29062a0e-7aca-47e4-9074-a642083d9c4b req-c75e9f9c-d5c6-4396-92d5-cb457702b7a0 tempest-AttachVolumeTestJSON-1650136813 None] attachment_update completed successfully. Sep 25 17:10:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Creating offline snapshot 9973a889-e455-4aff-aaf4-29c0f777881c of volume 16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:10:20 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc80825-262f-4e83-9b96-70a3a2d02f27]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:20 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab Sep 25 17:10:20 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:20 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab" returned: 0 in 0.603s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:20 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c 1G Sep 25 17:10:20 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:21 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c 1G" returned: 0 in 0.662s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df0710-b1bb-4442-a1e0-d25e54efbaab -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:21 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df0710-b1bb-4442-a1e0-d25e54efbaab -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c Sep 25 17:10:21 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:22 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df0710-b1bb-4442-a1e0-d25e54efbaab -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c" returned: 0 in 0.539s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:22 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c is being set with open permissions: ugo+rw Sep 25 17:10:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:22 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c Sep 25 17:10:22 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:22 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c" returned: 0 in 0.464s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:22 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.info Sep 25 17:10:22 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-7c4687d0-50ea-4fb8-bc2f-b73183118386 req-2b6c6dfa-4987-4971-be5e-4cdaedbe6ed5 tempest-AttachVolumeTestJSON-1650136813 None] Terminate volume connection completed successfully. Sep 25 17:10:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-7c4687d0-50ea-4fb8-bc2f-b73183118386 req-2b6c6dfa-4987-4971-be5e-4cdaedbe6ed5 tempest-AttachVolumeTestJSON-1650136813 None] Deleting attachment a840ff24-32b5-4c3b-810c-b47837f29ab4. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:10:23 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.info" returned: 0 in 0.445s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:23 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.info is being set with open permissions: ugo+rw Sep 25 17:10:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:23 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.info Sep 25 17:10:23 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:23 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.info" returned: 0 in 0.606s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.533s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-00f558d0-1848-404e-af31-45859596284c tempest-VolumesSnapshotListTestJSON-22035017 None] Create snapshot completed successfully Sep 25 17:10:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Creating offline snapshot 4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 of volume 16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:10:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-07917346-0657-496f-9eee-f8697a467a3b req-d8301c81-c216-4932-be97-7f86377674d6 tempest-AttachVolumeTestJSON-1650136813 None] Terminate volume connection completed successfully. Sep 25 17:10:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-07917346-0657-496f-9eee-f8697a467a3b req-d8301c81-c216-4932-be97-7f86377674d6 tempest-AttachVolumeTestJSON-1650136813 None] Deleting attachment f904a426-d625-4d19-940d-7bef4f3db22f. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:10:24 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e2e3f9-48e2-447b-8566-06eb30173666]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:25 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c Sep 25 17:10:25 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:25 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16df0710-b1bb-4442-a1e0-d25e54efbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:25 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 1G Sep 25 17:10:25 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2a03a164-be68-40a3-914f-923c4d529847 tempest-GroupsV314Test-1943016368 None] Group tempest-GroupsV314Test-Group-1906628068: creating Sep 25 17:10:26 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 1G" returned: 0 in 0.673s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2a03a164-be68-40a3-914f-923c4d529847 tempest-GroupsV314Test-1943016368 None] Group tempest-GroupsV314Test-Group-1906628068: created successfully Sep 25 17:10:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2a03a164-be68-40a3-914f-923c4d529847 tempest-GroupsV314Test-1943016368 None] Create group completed successfully. Sep 25 17:10:26 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 Sep 25 17:10:26 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:26 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" returned: 0 in 0.522s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:26 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 is being set with open permissions: ugo+rw Sep 25 17:10:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:26 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 Sep 25 17:10:26 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:26 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" returned: 0 in 0.369s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4710f93c-5c19-4839-9a77-bcfed03c93b3 tempest-VolumesSnapshotListTestJSON-22035017 None] Create snapshot completed successfully Sep 25 17:10:27 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Flow 'volume_create_manager' (88bec626-a451-4b08-8bb3-e7e0b614e048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c3442d-deff-40c3-8272-a5ffd9c40df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c3442d-deff-40c3-8272-a5ffd9c40df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2137404748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=380c7fe3-ca50-4dc9-8925-a36ed1a1e97b,host='devstack@QuobyteHD#QuobyteHD',id=605044ed-350e-438c-8187-c147217b4073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcaf7907aefa41d38a20d39602758fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:28Z,use_quota=True,user_id='da01162278e54189baef2a19f5812f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f61645c-859d-4505-827b-9a10e02aa5e6),volume_type_id=9f61645c-859d-4505-827b-9a10e02aa5e6)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859cf7f4-4b14-411c-a3f4-088dc376c57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859cf7f4-4b14-411c-a3f4-088dc376c57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636f8f69-726f-4814-a2d0-170c64c027d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636f8f69-726f-4814-a2d0-170c64c027d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605044ed-350e-438c-8187-c147217b4073', 'volume_name': 'volume-605044ed-350e-438c-8187-c147217b4073', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b77ec9b-dcb8-4bf9-9717-ceebe784c224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b77ec9b-dcb8-4bf9-9717-ceebe784c224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce690c60-04b3-4ae3-a2e9-43b4954cbc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:28 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Volume 605044ed-350e-438c-8187-c147217b4073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605044ed-350e-438c-8187-c147217b4073', 'volume_size': 1} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=380c7fe3-ca50-4dc9-8925-a36ed1a1e97b,created_at=2026-09-25T15:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2137404748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=380c7fe3-ca50-4dc9-8925-a36ed1a1e97b,host='devstack@QuobyteHD#QuobyteHD',id=605044ed-350e-438c-8187-c147217b4073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcaf7907aefa41d38a20d39602758fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:28Z,use_quota=True,user_id='da01162278e54189baef2a19f5812f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f61645c-859d-4505-827b-9a10e02aa5e6),volume_type_id=9f61645c-859d-4505-827b-9a10e02aa5e6)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Creating volume 605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:28 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:28 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 1073741824 Sep 25 17:10:28 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:28 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 1073741824" returned: 0 in 0.631s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:28 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 Sep 25 17:10:28 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:29 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073" returned: 0 in 0.307s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.723s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce690c60-04b3-4ae3-a2e9-43b4954cbc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605044ed-350e-438c-8187-c147217b4073', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200318e3-5dab-4247-9bf7-493bfeaa92f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Creating offline snapshot 5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 of volume 16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:10:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Volume volume-605044ed-350e-438c-8187-c147217b4073 (605044ed-350e-438c-8187-c147217b4073): created successfully Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200318e3-5dab-4247-9bf7-493bfeaa92f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Flow 'volume_create_manager' (88bec626-a451-4b08-8bb3-e7e0b614e048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa64b292-f59b-4ff4-a0ba-e65f4f10d55a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ded4bd24-cd4d-41d4-afcc-3c640c86b5e3 tempest-GroupsV314Test-1943016368 None] Created volume successfully. Sep 25 17:10:29 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 Sep 25 17:10:29 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:29 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" returned: 0 in 0.460s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16df0710-b1bb-4442-a1e0-d25e54efbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:29 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 1G Sep 25 17:10:29 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:30 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 1G" returned: 0 in 0.553s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:30 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 Sep 25 17:10:30 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "cinder-48676107-de8d-45b0-9be9-a9048d12a815-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-48676107-de8d-45b0-9be9-a9048d12a815-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "cinder-quobyte-48676107-de8d-45b0-9be9-a9048d12a815" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-quobyte-48676107-de8d-45b0-9be9-a9048d12a815" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf9806-4d33-42dc-bf80-827da265d321]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:30 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:30 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 is being set with open permissions: ugo+rw Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:30 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815 Sep 25 17:10:30 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:30 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 Sep 25 17:10:30 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:30 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815" returned: 0 in 0.457s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:30 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5" returned: 0 in 0.324s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:30 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815 Sep 25 17:10:30 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-eec35fc1-676c-4efe-899a-9884b8bb6742 tempest-VolumesSnapshotListTestJSON-22035017 None] Create snapshot completed successfully Sep 25 17:10:31 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48676107-de8d-45b0-9be9-a9048d12a815" returned: 0 in 0.273s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-quobyte-48676107-de8d-45b0-9be9-a9048d12a815" released by "delete_volume" :: held 0.795s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:31 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Cloning volume 605044ed-350e-438c-8187-c147217b4073 to volume e451d7f6-475b-4d4c-9bed-c67cf93981b2 Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Created reservations ['88e7d196-5565-40bf-be1c-bf5ce18e3654', '6bd12ece-9d36-46bb-82a2-0ba2db97259b', 'e35f04c4-663c-463a-b736-209160d86f50', 'cd3f3858-21d4-412e-b23a-9615b9f2ada6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Creating offline snapshot 629343f4-5c63-43ac-a3f3-badd324fdf43 of volume 605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[068ca031-dd08-49a6-82d7-eb7a72750277]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:31 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:31 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:31 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 Sep 25 17:10:31 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "cinder-fe5aeb1f-bca9-4f22-b0fe-def353594069-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-fe5aeb1f-bca9-4f22-b0fe-def353594069-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "cinder-quobyte-fe5aeb1f-bca9-4f22-b0fe-def353594069" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-quobyte-fe5aeb1f-bca9-4f22-b0fe-def353594069" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ab5ae5-f8f0-4729-9388-39e503157a2f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:31 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073" returned: 0 in 0.557s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:31 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.528s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Deleted volume successfully. Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=147,cinder:SELECT=154,cinder:INSERT=32,cinder:DELETE=9 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:10:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2528eb29-d80c-4029-ae5c-a070aaa95b6f tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-48676107-de8d-45b0-9be9-a9048d12a815-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:31 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 1G Sep 25 17:10:31 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:31 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 Sep 25 17:10:31 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:32 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069" returned: 0 in 0.531s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:32 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069 Sep 25 17:10:32 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:32 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 1G" returned: 0 in 0.701s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605044ed-350e-438c-8187-c147217b4073 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:32 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605044ed-350e-438c-8187-c147217b4073 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 Sep 25 17:10:32 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:32 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fe5aeb1f-bca9-4f22-b0fe-def353594069" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-quobyte-fe5aeb1f-bca9-4f22-b0fe-def353594069" released by "delete_volume" :: held 1.041s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:32 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=161,cinder:INSERT=35,cinder:UPDATE=153,cinder:DELETE=11 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:10:32 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Created reservations ['c049c925-d10b-4a7d-99f9-2e93da8e127d', '4db0860b-c856-49a2-ad4e-330f3fc635a1', 'c7b3b483-e36e-4950-a1e0-dce13a083ffb', '938d1e25-6174-4a90-8a45-387c4d6bc3ed'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:33 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605044ed-350e-438c-8187-c147217b4073 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43" returned: 0 in 0.505s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:33 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:33 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 Sep 25 17:10:33 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:33 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-quobyte-5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Deleting offline snapshot 5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 of volume 16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] snapshot_file for this snap is: volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f32ba8-53ef-4c62-8b79-831c46e8dd68]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:33 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 Sep 25 17:10:33 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:33 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:33 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:33 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.info Sep 25 17:10:33 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:34 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16df0710-b1bb-4442-a1e0-d25e54efbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:34 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:34 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.info" returned: 0 in 0.392s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:34 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4bc1b4-f956-41c2-86c5-8f6fce054e1c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Deleted volume successfully. Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:34 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.info Sep 25 17:10:34 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "cinder-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4776892c-b971-498a-8f7c-8bc6032a3823 tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-fe5aeb1f-bca9-4f22-b0fe-def353594069-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "cinder-quobyte-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-quobyte-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:34 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 Sep 25 17:10:34 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9238a6-d286-4be1-90cb-24c876acd3c9]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:34 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.info" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Acquiring lock "cinder-quobyte-e451d7f6-475b-4d4c-9bed-c67cf93981b2" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Lock "cinder-quobyte-e451d7f6-475b-4d4c-9bed-c67cf93981b2" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] snapshot: 629343f4-5c63-43ac-a3f3-badd324fdf43, volume: e451d7f6-475b-4d4c-9bed-c67cf93981b2, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dd6bde-d8e9-40ba-b70f-92859a21af72]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:34 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e Sep 25 17:10:34 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:34 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 Sep 25 17:10:34 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:34 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" returned: 0 in 0.625s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16df0710-b1bb-4442-a1e0-d25e54efbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:34 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 Sep 25 17:10:34 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:34 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e" returned: 0 in 0.529s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:34 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e Sep 25 17:10:34 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:35 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43" returned: 0 in 0.471s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605044ed-350e-438c-8187-c147217b4073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d026db2-e3e9-4f91-ab62-c74e9b85a3fd]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:35 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 Sep 25 17:10:35 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:35 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e" returned: 0 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-quobyte-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e" released by "delete_volume" :: held 0.943s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:35 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5" returned: 0 in 0.570s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:35 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5 Sep 25 17:10:35 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Created reservations ['bb3ab24a-27f5-4bef-9b18-7f37b87e2453', '207efb35-b749-41f5-9b56-dd4b4546f8dc', '073c6032-6e3d-4125-8c82-971f54cccee4', '28fb2a2c-9bbe-4035-bf42-9b9c0bde13ec'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:35 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073" returned: 0 in 0.557s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:35 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:35 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:35 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 Sep 25 17:10:35 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:35 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5" returned: 0 in 0.411s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5" released by "_delete_snapshot" :: held 2.298s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" released by "delete_snapshot" :: held 2.327s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:35 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Created reservations ['50aeb678-6eef-4d97-8d45-157bcee63b94', '072b6172-63dc-4bd7-b32b-506f437a8026', '0b63a776-defd-4280-b2cc-5e5c963732f2', '3198693e-18ee-4c59-9a91-2e1c74b991c6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:36 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Flow 'volume_create_manager' (02769030-3810-465c-8460-cf373f60a933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf93e8f-4cd7-4b9f-a477-2296efffe7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.475s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf93e8f-4cd7-4b9f-a477-2296efffe7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-339280104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118cd61f-d2ba-4426-ace9-9710fbfbdf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da94cc69479c408ca6e2ec80ad2e813a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:36Z,use_quota=True,user_id='1634b50dd6b0418aadb5170a21ef0726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c474e21-dde0-4124-be9d-088b7873a050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c474e21-dde0-4124-be9d-088b7873a050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c41ff72-495a-4f39-b0b6-c0661f1d61ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c41ff72-495a-4f39-b0b6-c0661f1d61ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '118cd61f-d2ba-4426-ace9-9710fbfbdf15', 'volume_name': 'volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa56919-7df8-4be1-a425-b0ea50fd56b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa56919-7df8-4be1-a425-b0ea50fd56b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee0c7f6-4cd9-4eef-99ab-0d7b2931cff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Volume 118cd61f-d2ba-4426-ace9-9710fbfbdf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15', 'volume_size': 1} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Deleted volume successfully. Sep 25 17:10:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Delete snapshot completed successfully. Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-58e63723-bdcb-455a-b1e9-56997d5bdafe tempest-AttachVolumeTestJSON-1650136813 None] Lock "cinder-4d7a506b-d231-4fa4-b2c2-a315d1c43c2e-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7ed69fa3-8b16-4d66-aec9-968579fbb141 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-5a771fc3-13a6-4ca3-9e6d-af98d3a5b6b5-delete_snapshot" released by "delete_snapshot" :: held 2.693s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-4cb3bba2-bea7-40a1-a572-2beafe5ba1c5-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-4cb3bba2-bea7-40a1-a572-2beafe5ba1c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-quobyte-4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Deleting offline snapshot 4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 of volume 16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:10:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] snapshot_file for this snap is: volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:10:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa07b9-aac4-49b5-888b-9e01302b1ea7]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:37 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 Sep 25 17:10:37 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:37 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" returned: 0 in 0.812s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16df0710-b1bb-4442-a1e0-d25e54efbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[df511772-166c-4a9e-aeb7-3726ad0c7fe6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:38 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c Sep 25 17:10:38 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:39 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c" returned: 0 in 1.113s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16df0710-b1bb-4442-a1e0-d25e54efbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:39 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 Sep 25 17:10:39 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:39 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" returned: 0 in 0.845s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:40 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5 Sep 25 17:10:40 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:40 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" returned: 0 in 0.489s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-4cb3bba2-bea7-40a1-a572-2beafe5ba1c5" released by "_delete_snapshot" :: held 3.550s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" released by "delete_snapshot" :: held 3.605s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Created reservations ['a036df52-c0df-43eb-8c34-35f65f610292', '2555e1e2-d8a1-4df2-83d7-bc450dd3ef7a', '37ddcdef-c4e6-40f8-86fa-73489a2345df', 'da9e4734-5d49-43d3-9198-6f2aef967d6f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Delete snapshot completed successfully. Sep 25 17:10:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-612dd257-038a-4538-9d60-da4bf0cffe6f tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-4cb3bba2-bea7-40a1-a572-2beafe5ba1c5-delete_snapshot" released by "delete_snapshot" :: held 3.974s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-9973a889-e455-4aff-aaf4-29c0f777881c-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-9973a889-e455-4aff-aaf4-29c0f777881c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-quobyte-9973a889-e455-4aff-aaf4-29c0f777881c" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-9973a889-e455-4aff-aaf4-29c0f777881c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Deleting offline snapshot 9973a889-e455-4aff-aaf4-29c0f777881c of volume 16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] snapshot_file for this snap is: volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c5f0e-043f-4239-80c9-304f77e3483f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:41 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c Sep 25 17:10:41 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:42 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c" returned: 0 in 0.832s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16df0710-b1bb-4442-a1e0-d25e54efbaab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d1a61-c9ef-47a6-b9eb-3f20cc1f5248]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:42 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab Sep 25 17:10:42 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:43 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab" returned: 0 in 0.857s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:43 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c Sep 25 17:10:43 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:44 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c" returned: 0 in 0.712s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:44 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c Sep 25 17:10:44 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:44 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2" returned: 0 in 8.681s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073, size 1024.00 MB, duration 8.68 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:10:44 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Converted 1024.00 MB image at 117.94 MB/s Sep 25 17:10:44 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:44 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 Sep 25 17:10:44 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:44 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab.9973a889-e455-4aff-aaf4-29c0f777881c" returned: 0 in 0.437s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-9973a889-e455-4aff-aaf4-29c0f777881c" released by "_delete_snapshot" :: held 3.137s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" released by "delete_snapshot" :: held 3.174s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Created reservations ['1dae4df8-f102-4d36-a999-b86b7d3a0b50', '622e5398-e163-4527-8429-260fa8a38569', '6cbca27a-c8da-4c16-a1c8-bd22dd106ba0', '93ebee6b-967c-42e0-b552-a26766d241c9'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:44 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Lock "cinder-quobyte-e451d7f6-475b-4d4c-9bed-c67cf93981b2" released by "_copy_volume_from_snapshot" :: held 10.235s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Delete snapshot completed successfully. Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Acquiring lock "cinder-quobyte-629343f4-5c63-43ac-a3f3-badd324fdf43" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d8a77707-21db-4a0f-b2d1-d7f632cae483 tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-9973a889-e455-4aff-aaf4-29c0f777881c-delete_snapshot" released by "delete_snapshot" :: held 3.405s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Lock "cinder-quobyte-629343f4-5c63-43ac-a3f3-badd324fdf43" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Deleting offline snapshot 629343f4-5c63-43ac-a3f3-badd324fdf43 of volume 605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] snapshot_file for this snap is: volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fb4c99-4333-4bc5-a1ca-e424fa2cae97]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:44 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 Sep 25 17:10:45 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:45 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43" returned: 0 in 0.443s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605044ed-350e-438c-8187-c147217b4073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:10:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddd4a70-5f72-498e-ad62-3871c4435994]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:45 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 Sep 25 17:10:45 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-16df0710-b1bb-4442-a1e0-d25e54efbaab-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-16df0710-b1bb-4442-a1e0-d25e54efbaab-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:46 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073" returned: 0 in 0.773s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d40432-460a-42ea-a91f-d8b8c6012a57]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:46 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 Sep 25 17:10:46 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:46 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab Sep 25 17:10:46 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:46 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43" returned: 0 in 0.479s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:46 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab" returned: 0 in 0.481s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:46 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43 Sep 25 17:10:46 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:46 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab Sep 25 17:10:46 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:46 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073.629343f4-5c63-43ac-a3f3-badd324fdf43" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:46 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-16df0710-b1bb-4442-a1e0-d25e54efbaab" returned: 0 in 0.349s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Lock "cinder-quobyte-629343f4-5c63-43ac-a3f3-badd324fdf43" released by "_delete_snapshot" :: held 2.170s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-quobyte-16df0710-b1bb-4442-a1e0-d25e54efbaab" released by "delete_volume" :: held 0.964s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.777s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.872s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-339280104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118cd61f-d2ba-4426-ace9-9710fbfbdf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da94cc69479c408ca6e2ec80ad2e813a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:10:36Z,use_quota=True,user_id='1634b50dd6b0418aadb5170a21ef0726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Creating volume 118cd61f-d2ba-4426-ace9-9710fbfbdf15 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:10:47 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:47 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 1073741824 Sep 25 17:10:47 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cee815ea-dba8-425f-aa60-1714574cfe48 tempest-GroupsV314Test-1943016368 None] Create group from source-group-380c7fe3-ca50-4dc9-8925-a36ed1a1e97b completed successfully. Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Created reservations ['ad1a8729-d06c-48c7-b8a3-7e2363d629e5', 'b22e156b-f225-4771-ae5f-6d10608c267e', '22f46c9c-3af5-449b-a85b-b755fd3fa86d', 'e87ce5d1-3ee9-4b2e-b081-65f28a74892a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:47 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:47 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:47 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Deleted volume successfully. Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d0c7fc7-d430-460e-b152-ffea6da3ce5e tempest-VolumesSnapshotListTestJSON-22035017 None] Lock "cinder-16df0710-b1bb-4442-a1e0-d25e54efbaab-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:47 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 1073741824" returned: 0 in 0.747s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:47 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 Sep 25 17:10:47 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Acquiring lock "cinder-quobyte-e451d7f6-475b-4d4c-9bed-c67cf93981b2" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Lock "cinder-quobyte-e451d7f6-475b-4d4c-9bed-c67cf93981b2" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e91af8-72cf-4042-9e4f-83291442d917]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:48 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 Sep 25 17:10:48 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:48 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15" returned: 0 in 0.361s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee0c7f6-4cd9-4eef-99ab-0d7b2931cff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f2ebc8-4067-4ef9-b457-9430ade0dabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:10:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Volume volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 (118cd61f-d2ba-4426-ace9-9710fbfbdf15): created successfully Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f2ebc8-4067-4ef9-b457-9430ade0dabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Flow 'volume_create_manager' (02769030-3810-465c-8460-cf373f60a933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:10:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-12556c16-2274-4cd5-b1a3-c1d465a15a5c tempest-AttachVolumeNegativeTest-2013442506 None] Created volume successfully. Sep 25 17:10:48 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2" returned: 0 in 0.493s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:48 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2 Sep 25 17:10:48 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:48 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e451d7f6-475b-4d4c-9bed-c67cf93981b2" returned: 0 in 0.313s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Lock "cinder-quobyte-e451d7f6-475b-4d4c-9bed-c67cf93981b2" released by "delete_volume" :: held 0.875s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:48 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Created reservations ['816945a9-f83f-4b4b-b654-97c383fa0600'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:48 devstack cinder-volume[87232]: WARNING cinder.quota [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1194954330 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1194954330, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:10:48 devstack cinder-volume[87232]: WARNING cinder.quota [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1194954330 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1194954330, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Created reservations ['35ceea8a-7eac-4932-b082-7422eb11f1cd', '1a41f1d8-9b90-4a91-8369-50e0d45da6af', '7eee6166-f6cf-4a22-8a24-bbe2b3edceee', '2e588a4b-ccf1-43e3-a55f-f063d6aba73e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:49 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:49 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:49 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-987fa800-6ae5-4794-834e-2d1746c09020 tempest-GroupsV314Test-1943016368 None] Delete group completed successfully. Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Acquiring lock "cinder-quobyte-605044ed-350e-438c-8187-c147217b4073" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Lock "cinder-quobyte-605044ed-350e-438c-8187-c147217b4073" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ad253-77ec-4f55-9872-9acd04783776]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:10:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:49 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 Sep 25 17:10:49 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:50 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073" returned: 0 in 0.585s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:50 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073 Sep 25 17:10:50 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:50 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-605044ed-350e-438c-8187-c147217b4073" returned: 0 in 0.435s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Lock "cinder-quobyte-605044ed-350e-438c-8187-c147217b4073" released by "delete_volume" :: held 1.186s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:10:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Created reservations ['f2a52684-7bc7-4095-9a40-a19715444bd9'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Created reservations ['a982d6a4-ed87-49c1-a50e-b85b766018f4', '993fe97c-c56e-4f08-b021-296348748a49', '889ec9d6-a22d-4be4-ac3e-c3b6cc17903a', '236efba8-7bff-4574-a783-8081e229d7be'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:51 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:51 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-d5df8d30-e770-4299-87f0-7e309f8de35d req-4a4657c1-8169-4daf-bc5c-80d6bae1ff1a tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-d5df8d30-e770-4299-87f0-7e309f8de35d req-4a4657c1-8169-4daf-bc5c-80d6bae1ff1a tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-d5df8d30-e770-4299-87f0-7e309f8de35d req-4a4657c1-8169-4daf-bc5c-80d6bae1ff1a tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-d5df8d30-e770-4299-87f0-7e309f8de35d req-4a4657c1-8169-4daf-bc5c-80d6bae1ff1a tempest-AttachVolumeNegativeTest-2013442506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26aa05f1-2c8a-4fc5-964c-eea45ebf6a89', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:10:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-d5df8d30-e770-4299-87f0-7e309f8de35d req-4a4657c1-8169-4daf-bc5c-80d6bae1ff1a tempest-AttachVolumeNegativeTest-2013442506 None] attachment_update completed successfully. Sep 25 17:10:51 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:51 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9475b7a6-846b-406f-a1a0-cc8b6e2cfaf6 tempest-GroupsV314Test-1943016368 None] Delete group completed successfully. Sep 25 17:10:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-91ad4f3c-ae4b-4d0b-959e-b6fbd2750941 req-00c064ba-5a4c-4b9a-906e-6aa60a18b7fc tempest-AttachVolumeNegativeTest-2013442506 None] Terminate volume connection completed successfully. Sep 25 17:10:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-91ad4f3c-ae4b-4d0b-959e-b6fbd2750941 req-00c064ba-5a4c-4b9a-906e-6aa60a18b7fc tempest-AttachVolumeNegativeTest-2013442506 None] Deleting attachment 26aa05f1-2c8a-4fc5-964c-eea45ebf6a89. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:10:56 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:10:56 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:10:56 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.575s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:10:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:11:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fca16984-80c4-4934-84fc-9b445bd3826b tempest-GroupSnapshotsV319Test-908714011 None] Group tempest-GroupSnapshotsV319Test-Group-125660: creating Sep 25 17:11:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fca16984-80c4-4934-84fc-9b445bd3826b tempest-GroupSnapshotsV319Test-908714011 None] Group tempest-GroupSnapshotsV319Test-Group-125660: created successfully Sep 25 17:11:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fca16984-80c4-4934-84fc-9b445bd3826b tempest-GroupSnapshotsV319Test-908714011 None] Create group completed successfully. Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Flow 'volume_create_manager' (0ed7e4a7-9c53-4ffc-9daf-61230b241eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf05db9-e06b-4089-b20d-c62e14caad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf05db9-e06b-4089-b20d-c62e14caad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678002182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4bd6bdaf-2684-420d-82eb-55980e09842b,host='devstack@QuobyteHD#QuobyteHD',id=4d83dea0-4f9a-41ad-8a0b-914b37c0258b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='266c2a651c9f41d0a5da2e645468b161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:02Z,use_quota=True,user_id='9130e984c745429aba149eb502a8d131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb5abae4-9422-4125-8623-e57e4ed4f517),volume_type_id=fb5abae4-9422-4125-8623-e57e4ed4f517)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9e826d-5bfb-43a6-891b-e36d096b7faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9e826d-5bfb-43a6-891b-e36d096b7faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964da568-0426-448b-b52d-067a1b8da210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964da568-0426-448b-b52d-067a1b8da210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d83dea0-4f9a-41ad-8a0b-914b37c0258b', 'volume_name': 'volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588ce3e6-7284-4ca3-8872-afdc8ba86fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588ce3e6-7284-4ca3-8872-afdc8ba86fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947ac5d2-b382-4406-ba14-3652607b2830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Volume 4d83dea0-4f9a-41ad-8a0b-914b37c0258b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b', 'volume_size': 1} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4bd6bdaf-2684-420d-82eb-55980e09842b,created_at=2026-09-25T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678002182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4bd6bdaf-2684-420d-82eb-55980e09842b,host='devstack@QuobyteHD#QuobyteHD',id=4d83dea0-4f9a-41ad-8a0b-914b37c0258b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='266c2a651c9f41d0a5da2e645468b161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:02Z,use_quota=True,user_id='9130e984c745429aba149eb502a8d131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb5abae4-9422-4125-8623-e57e4ed4f517),volume_type_id=fb5abae4-9422-4125-8623-e57e4ed4f517)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Creating volume 4d83dea0-4f9a-41ad-8a0b-914b37c0258b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:02 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:02 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b 1073741824 Sep 25 17:11:02 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "cinder-118cd61f-d2ba-4426-ace9-9710fbfbdf15-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:03 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-118cd61f-d2ba-4426-ace9-9710fbfbdf15-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b 1073741824" returned: 0 in 0.759s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "cinder-quobyte-118cd61f-d2ba-4426-ace9-9710fbfbdf15" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-quobyte-118cd61f-d2ba-4426-ace9-9710fbfbdf15" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef56b832-824b-41fc-b850-0ba80b70674f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:03 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b Sep 25 17:11:03 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:03 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 Sep 25 17:11:03 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:03 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947ac5d2-b382-4406-ba14-3652607b2830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866e0940-eee2-4de6-b5e2-b2599e539cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Volume volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b (4d83dea0-4f9a-41ad-8a0b-914b37c0258b): created successfully Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866e0940-eee2-4de6-b5e2-b2599e539cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Flow 'volume_create_manager' (0ed7e4a7-9c53-4ffc-9daf-61230b241eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e9c96128-c493-4492-beec-2f548eaef4f2 tempest-GroupSnapshotsV319Test-908714011 None] Created volume successfully. Sep 25 17:11:03 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15" returned: 0 in 0.499s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:04 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15 Sep 25 17:11:04 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:04 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-118cd61f-d2ba-4426-ace9-9710fbfbdf15" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-quobyte-118cd61f-d2ba-4426-ace9-9710fbfbdf15" released by "delete_volume" :: held 0.989s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Created reservations ['bd6cccbd-42c1-489b-9954-dcc19efbfec5', '959408fb-609b-4dcb-b53a-1df8045bf1ba', '4547ce70-c971-4ec7-9321-3935a2bcea3a', 'c5c18462-20c2-4987-b2bb-abcfb5ce52f1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:04 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:11:04 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:05 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.397s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Deleted volume successfully. Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3b155ab-f6d1-4ef9-8a41-31e6e70dfe28 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-118cd61f-d2ba-4426-ace9-9710fbfbdf15-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] GroupSnapshot 600a1371-bdfc-45bd-a00c-9b9a3c45b215: creating. Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Group snapshot 600a1371-bdfc-45bd-a00c-9b9a3c45b215: creating. {{(pid=87232) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Creating offline snapshot 134aec0f-7ec2-47a4-9d67-c418db114b50 of volume 4d83dea0-4f9a-41ad-8a0b-914b37c0258b {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d11962e-d691-43e8-9449-2949fa83ec50]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:05 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b Sep 25 17:11:05 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "cinder-9cbb50bb-555c-4fb5-9010-61ec13058b94-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-9cbb50bb-555c-4fb5-9010-61ec13058b94-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "cinder-quobyte-9cbb50bb-555c-4fb5-9010-61ec13058b94" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-quobyte-9cbb50bb-555c-4fb5-9010-61ec13058b94" acquired by "delete_volume" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa119c4-a707-4fa5-bd21-d4c3d1441256]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:06 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" returned: 0 in 0.775s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:06 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 1G Sep 25 17:11:06 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:06 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 Sep 25 17:11:06 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:06 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94" returned: 0 in 0.523s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:06 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94 Sep 25 17:11:06 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:06 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 1G" returned: 0 in 0.673s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:07 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 Sep 25 17:11:07 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:07 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9cbb50bb-555c-4fb5-9010-61ec13058b94" returned: 0 in 0.337s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-quobyte-9cbb50bb-555c-4fb5-9010-61ec13058b94" released by "delete_volume" :: held 0.957s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Created reservations ['59122f56-1a23-41a1-a94d-fb23faa628db', '594cea67-ba72-4f49-b7b5-0cfb1390c3cf', 'e09675bc-6fd3-4216-addc-cf77755a8c0e', '01dc801a-e0a1-4f56-9186-35ca3f6a18be'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:07 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:11:07 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:07 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:07 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:07 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 Sep 25 17:11:07 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:07 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Deleted volume successfully. Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0050c5cf-abf4-427f-9efb-0dfccefb8ae9 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-9cbb50bb-555c-4fb5-9010-61ec13058b94-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:07 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:08 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.info Sep 25 17:11:08 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:08 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.info" returned: 0 in 0.380s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:08 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:08 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.info Sep 25 17:11:08 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "cinder-182518a7-ae53-4953-ac69-dc62e05540f1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-182518a7-ae53-4953-ac69-dc62e05540f1-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:08 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.info" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.315s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "cinder-quobyte-182518a7-ae53-4953-ac69-dc62e05540f1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-quobyte-182518a7-ae53-4953-ac69-dc62e05540f1" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb168cdc-952a-438a-a168-597bdd6e1e4a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:09 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1 Sep 25 17:11:09 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3a2b43ad-2818-448c-a539-00617e3f6e9a tempest-GroupSnapshotsV319Test-908714011 None] group_snapshot 600a1371-bdfc-45bd-a00c-9b9a3c45b215: created successfully Sep 25 17:11:09 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1" returned: 0 in 0.509s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:09 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1 Sep 25 17:11:09 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:09 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-182518a7-ae53-4953-ac69-dc62e05540f1" returned: 0 in 0.458s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-quobyte-182518a7-ae53-4953-ac69-dc62e05540f1" released by "delete_volume" :: held 1.047s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Created reservations ['ee6b27ba-34eb-4f17-98ef-86a7211909c7', '720d4150-0cf9-4271-96f3-612fae9d439e', '8a8e3fd2-ee62-4dba-8c30-28c2b686d59c', '024ad68c-e04b-4c60-a7d5-e2b7192397fb'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:10 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:11:10 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] group_snapshot 600a1371-bdfc-45bd-a00c-9b9a3c45b215: deleting Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] group_snapshot 600a1371-bdfc-45bd-a00c-9b9a3c45b215: deleting {{(pid=87232) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 17:11:10 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.548s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Deleted volume successfully. Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Acquiring lock "cinder-quobyte-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d5f02ad6-6aa1-4e2a-94e1-02a5c93228f2 tempest-AttachVolumeNegativeTest-2013442506 None] Lock "cinder-182518a7-ae53-4953-ac69-dc62e05540f1-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Lock "cinder-quobyte-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Acquiring lock "cinder-quobyte-134aec0f-7ec2-47a4-9d67-c418db114b50" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Lock "cinder-quobyte-134aec0f-7ec2-47a4-9d67-c418db114b50" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Deleting offline snapshot 134aec0f-7ec2-47a4-9d67-c418db114b50 of volume 4d83dea0-4f9a-41ad-8a0b-914b37c0258b {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] snapshot_file for this snap is: volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d376b4f-dda3-4c81-926b-bd733f452894]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:11 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 Sep 25 17:11:11 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:11 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50" returned: 0 in 0.568s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:11:11 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4fdcfa-4168-4e6a-8b43-2557e313ed45]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:11 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b Sep 25 17:11:11 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:12 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" returned: 0 in 0.627s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:12 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 Sep 25 17:11:12 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:12 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50" returned: 0 in 0.558s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:12 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50 Sep 25 17:11:12 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:13 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b.134aec0f-7ec2-47a4-9d67-c418db114b50" returned: 0 in 0.438s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Lock "cinder-quobyte-134aec0f-7ec2-47a4-9d67-c418db114b50" released by "_delete_snapshot" :: held 2.399s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Lock "cinder-quobyte-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" released by "delete_snapshot" :: held 2.442s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:13 devstack cinder-volume[87232]: WARNING cinder.quota [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-610434762 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-610434762, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:11:13 devstack cinder-volume[87232]: WARNING cinder.quota [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-610434762 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-610434762, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:11:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] Created reservations ['9e03af1a-1db3-46a9-a677-62e224cc1e8e', 'cfd2da33-c71e-4cf0-9bc4-ee43798d44af', 'dc666eab-e977-447e-8f3d-c1a9abcebe6e', 'cce78953-4596-4d75-a004-68d9349c19ca'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d1fdf3b3-d642-410c-a8f9-86ae1145c672 tempest-GroupSnapshotsV319Test-908714011 None] group_snapshot 600a1371-bdfc-45bd-a00c-9b9a3c45b215: deleted successfully Sep 25 17:11:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Acquiring lock "cinder-quobyte-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Lock "cinder-quobyte-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e89b09-d677-4a1f-88f8-56f04f25e81b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:14 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b Sep 25 17:11:14 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:15 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" returned: 0 in 0.581s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:15 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b Sep 25 17:11:15 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:15 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Lock "cinder-quobyte-4d83dea0-4f9a-41ad-8a0b-914b37c0258b" released by "delete_volume" :: held 1.135s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Created reservations ['1ca8db20-812e-404c-bd1f-3cc38138199e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:15 devstack cinder-volume[87232]: WARNING cinder.quota [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-610434762 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-610434762, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:11:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Created reservations ['1cc5da80-ac8a-4133-bf7e-6a0fac8bba5d', '556a9019-8890-4d23-abe9-6102a1190bcc', '5ee8e414-a369-4170-9b38-a3b6107ed1ea', '9aecdfc1-f8ee-4fe0-9625-7e548844b345'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:16 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:11:16 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:16 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.394s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:16 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2d6ff321-bb70-4cdf-bdf7-eb6d30b0a1a4 tempest-GroupSnapshotsV319Test-908714011 None] Delete group completed successfully. Sep 25 17:11:26 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=95,cinder:INSERT=33,cinder:UPDATE=116,cinder:DELETE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:11:26 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=99,cinder:INSERT=26,cinder:UPDATE=117,cinder:DELETE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Flow 'volume_create_manager' (4aadd113-5a25-4e8e-a080-ecae7bb1c8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abffa49-12ea-4e42-bffd-400c0e22af98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abffa49-12ea-4e42-bffd-400c0e22af98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1588773443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c632b41333440e99390f9d40a747244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:28Z,use_quota=True,user_id='c85b2796273c47db871edbbf291a11b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16f5fe9-39eb-495f-9867-d6fba0e19289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16f5fe9-39eb-495f-9867-d6fba0e19289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1ba245-569e-4311-ba6f-755cda31a0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1ba245-569e-4311-ba6f-755cda31a0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44', 'volume_name': 'volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33dc6021-9905-4d12-831e-5eb299b9f05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33dc6021-9905-4d12-831e-5eb299b9f05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ea38b9-e292-4a80-820a-caa2d0900692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:27 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Volume c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44', 'volume_size': 1} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1588773443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c632b41333440e99390f9d40a747244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:28Z,use_quota=True,user_id='c85b2796273c47db871edbbf291a11b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Creating volume c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:27 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:27 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 1073741824 Sep 25 17:11:27 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:28 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 1073741824" returned: 0 in 0.673s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:28 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 Sep 25 17:11:28 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:28 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ea38b9-e292-4a80-820a-caa2d0900692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a7f77e-15ed-40b9-81f6-d071cb63a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:28 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Volume volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 (c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44): created successfully Sep 25 17:11:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a7f77e-15ed-40b9-81f6-d071cb63a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Flow 'volume_create_manager' (4aadd113-5a25-4e8e-a080-ecae7bb1c8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-860826a0-5b7e-41a5-a03d-be411ba6a762 req-01065850-c819-4c17-8350-dc768e059b9d tempest-VolumesSnapshotsTestJSON-1761214413 None] Created volume successfully. Sep 25 17:11:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Creating offline snapshot 7d83910f-90af-4767-beb1-514d3baf1015 of volume c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:11:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3d21e4-3f01-4d03-b499-43d32c1a0b23]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:29 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 Sep 25 17:11:29 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:30 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" returned: 0 in 0.530s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:30 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 1G Sep 25 17:11:30 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:30 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 1G" returned: 0 in 0.677s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:30 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 Sep 25 17:11:30 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:31 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015" returned: 0 in 0.470s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:31 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 is being set with open permissions: ugo+rw Sep 25 17:11:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:31 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 Sep 25 17:11:31 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:31 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015" returned: 0 in 0.410s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:31 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.info Sep 25 17:11:31 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:32 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.info" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:32 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.info is being set with open permissions: ugo+rw Sep 25 17:11:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:32 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.info Sep 25 17:11:32 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-28f710c3-c57f-4376-b4b4-2cceefcbb53b tempest-GroupsTest-419697263 None] Group tempest-Group1-967611760: creating Sep 25 17:11:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-28f710c3-c57f-4376-b4b4-2cceefcbb53b tempest-GroupsTest-419697263 None] Group tempest-Group1-967611760: created successfully Sep 25 17:11:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-28f710c3-c57f-4376-b4b4-2cceefcbb53b tempest-GroupsTest-419697263 None] Create group completed successfully. Sep 25 17:11:32 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.info" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-08cae986-e2ea-4416-8d3c-f37d61d3741d req-c860b6fa-4fd1-4286-aaf0-940a9394c0b9 tempest-VolumesSnapshotsTestJSON-1761214413 None] Create snapshot completed successfully Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Acquiring lock "cinder-7d83910f-90af-4767-beb1-514d3baf1015-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-7d83910f-90af-4767-beb1-514d3baf1015-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Acquiring lock "cinder-quobyte-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-quobyte-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Acquiring lock "cinder-quobyte-7d83910f-90af-4767-beb1-514d3baf1015" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-quobyte-7d83910f-90af-4767-beb1-514d3baf1015" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Deleting offline snapshot 7d83910f-90af-4767-beb1-514d3baf1015 of volume c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] snapshot_file for this snap is: volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bc9beb-744e-46e4-b371-e3a16adc2ee4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-98426ffb-1cd8-404e-8440-cdd165da9693 tempest-GroupsTest-419697263 None] Group tempest-Group2-47815937: creating Sep 25 17:11:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-98426ffb-1cd8-404e-8440-cdd165da9693 tempest-GroupsTest-419697263 None] Group tempest-Group2-47815937: created successfully Sep 25 17:11:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-98426ffb-1cd8-404e-8440-cdd165da9693 tempest-GroupsTest-419697263 None] Create group completed successfully. Sep 25 17:11:33 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 Sep 25 17:11:33 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:34 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015" returned: 0 in 0.516s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:11:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec0855f-01bd-42dc-9ff7-8222dfd7a593]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:34 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 Sep 25 17:11:34 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:34 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:34 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 Sep 25 17:11:34 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:35 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015" returned: 0 in 0.468s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:35 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015 Sep 25 17:11:35 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:35 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44.7d83910f-90af-4767-beb1-514d3baf1015" returned: 0 in 0.586s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:35 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Flow 'volume_create_manager' (07962101-ece2-4598-8966-832854a79e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243d2a31-d37a-4d07-bfd8-4b0ce50dc43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-quobyte-7d83910f-90af-4767-beb1-514d3baf1015" released by "_delete_snapshot" :: held 2.426s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243d2a31-d37a-4d07-bfd8-4b0ce50dc43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720813967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca12b45e-0190-4b8d-88a9-296a2247bd2d,host='devstack@QuobyteHD#QuobyteHD',id=dde2723f-7f54-437c-9cee-ea0451b37762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5eb4ef177c4e9080fdb1f1c49a62f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:36Z,use_quota=True,user_id='10624a120bea48a58612e2b204f8bf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25a95089-378d-4e39-95c9-bbe5974a340b),volume_type_id=25a95089-378d-4e39-95c9-bbe5974a340b)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a0bfdf-578e-4421-8ca6-f57883ca3a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a0bfdf-578e-4421-8ca6-f57883ca3a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8930e73e-e05a-46d2-b194-16d82c43275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8930e73e-e05a-46d2-b194-16d82c43275b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde2723f-7f54-437c-9cee-ea0451b37762', 'volume_name': 'volume-dde2723f-7f54-437c-9cee-ea0451b37762', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c19f59a-ed2c-40b7-9a9b-c6e075354a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c19f59a-ed2c-40b7-9a9b-c6e075354a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824721e4-7fe1-4ecd-a530-610226b458cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Volume dde2723f-7f54-437c-9cee-ea0451b37762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde2723f-7f54-437c-9cee-ea0451b37762', 'volume_size': 1} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ca12b45e-0190-4b8d-88a9-296a2247bd2d,created_at=2026-09-25T15:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720813967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ca12b45e-0190-4b8d-88a9-296a2247bd2d,host='devstack@QuobyteHD#QuobyteHD',id=dde2723f-7f54-437c-9cee-ea0451b37762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5eb4ef177c4e9080fdb1f1c49a62f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:36Z,use_quota=True,user_id='10624a120bea48a58612e2b204f8bf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25a95089-378d-4e39-95c9-bbe5974a340b),volume_type_id=25a95089-378d-4e39-95c9-bbe5974a340b)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Creating volume dde2723f-7f54-437c-9cee-ea0451b37762 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:36 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-quobyte-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" released by "delete_snapshot" :: held 2.587s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:36 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762 1073741824 Sep 25 17:11:36 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.quota [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Created reservations ['2485f0c1-abd6-40ee-8a23-2190c7cc408f', '83b8b069-6b3f-4343-acf8-afafdaf50f53', '5f835adb-9293-4e25-acda-ced74c35adc9', 'a2a9ab35-b148-4fe0-8d99-614bb795349e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Delete snapshot completed successfully. Sep 25 17:11:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-f75164a6-4dd5-4a4e-bd01-51fd416e974b req-09e4d090-3b54-47c5-9804-344c6f34cadc tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-7d83910f-90af-4767-beb1-514d3baf1015-delete_snapshot" released by "delete_snapshot" :: held 2.991s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:37 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762 1073741824" returned: 0 in 0.912s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:37 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762 Sep 25 17:11:37 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Acquiring lock "cinder-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Acquiring lock "cinder-quobyte-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-quobyte-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" acquired by "delete_volume" :: waited 0.048s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb10a63-9118-4eae-811e-747becafae78]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:37 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762" returned: 0 in 0.561s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824721e4-7fe1-4ecd-a530-610226b458cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde2723f-7f54-437c-9cee-ea0451b37762', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2554a670-4a45-4170-99f7-08ee3eeccb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Volume volume-dde2723f-7f54-437c-9cee-ea0451b37762 (dde2723f-7f54-437c-9cee-ea0451b37762): created successfully Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2554a670-4a45-4170-99f7-08ee3eeccb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Flow 'volume_create_manager' (07962101-ece2-4598-8966-832854a79e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c784a2f3-4f34-43e6-93fc-bfe2cf41e1dc tempest-GroupsTest-419697263 None] Created volume successfully. Sep 25 17:11:37 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 Sep 25 17:11:37 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:38 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" returned: 0 in 0.543s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:38 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44 Sep 25 17:11:38 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:38 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" returned: 0 in 0.328s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-quobyte-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44" released by "delete_volume" :: held 1.019s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG cinder.quota [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Created reservations ['6072def5-59db-457e-b346-b4b00fc3f8d5', 'bb599df6-54f8-41fa-a63b-bbfbde30d76a', 'c1a0d414-0b78-4c41-af12-e09d8ebb138d', 'a376df16-9bf7-49be-91d4-cf0e0023abba'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:38 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:11:38 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:39 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.331s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:39 devstack cinder-volume[87232]: DEBUG cinder.manager [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Deleted volume successfully. Sep 25 17:11:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-1cd5ab8c-4146-4546-a9c9-23d0cc836864 req-2b09ea84-f95e-4e47-abd0-921be989da9f tempest-VolumesSnapshotsTestJSON-1761214413 None] Lock "cinder-c458b47b-6b7d-4cd2-bbe5-7c0b5ce21e44-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Acquiring lock "cinder-quobyte-dde2723f-7f54-437c-9cee-ea0451b37762" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Lock "cinder-quobyte-dde2723f-7f54-437c-9cee-ea0451b37762" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e4f9e5-7e63-4913-a5ea-c3b0410b70d4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:40 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762 Sep 25 17:11:40 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Flow 'volume_create_manager' (fbfba096-5b22-40e2-bf01-a49169a2e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d913b860-b6f3-48c5-994d-894ebafd4bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d913b860-b6f3-48c5-994d-894ebafd4bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1791715289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c972f6a-11bc-45af-b50f-02bab3a9893f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb165da099542d4a416b64c5e9e00f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:40Z,use_quota=True,user_id='72be6d9ac5de4294807cde598c3cabbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d282c2c9-a896-46c5-9cf5-9b088a51bf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d282c2c9-a896-46c5-9cf5-9b088a51bf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8ed8ca-bdc1-47d2-999b-5d4e1baf737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8ed8ca-bdc1-47d2-999b-5d4e1baf737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c972f6a-11bc-45af-b50f-02bab3a9893f', 'volume_name': 'volume-6c972f6a-11bc-45af-b50f-02bab3a9893f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fab6e97-f327-4172-99e8-afbd257c2df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fab6e97-f327-4172-99e8-afbd257c2df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc721af7-d0a5-4a16-bd10-c63567826bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Volume 6c972f6a-11bc-45af-b50f-02bab3a9893f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c972f6a-11bc-45af-b50f-02bab3a9893f', 'volume_size': 1} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1791715289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c972f6a-11bc-45af-b50f-02bab3a9893f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb165da099542d4a416b64c5e9e00f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:40Z,use_quota=True,user_id='72be6d9ac5de4294807cde598c3cabbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Creating volume 6c972f6a-11bc-45af-b50f-02bab3a9893f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:40 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:40 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f 1073741824 Sep 25 17:11:40 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:40 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762" returned: 0 in 0.710s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:40 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762 Sep 25 17:11:40 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:41 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-dde2723f-7f54-437c-9cee-ea0451b37762" returned: 0 in 0.431s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Lock "cinder-quobyte-dde2723f-7f54-437c-9cee-ea0451b37762" released by "delete_volume" :: held 1.228s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:41 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f 1073741824" returned: 0 in 0.803s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:41 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f Sep 25 17:11:41 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Created reservations ['d713aef3-427f-4ca5-b1c3-3f90e290d9b5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:41 devstack cinder-volume[87232]: WARNING cinder.quota [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-817266148 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-817266148, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:11:41 devstack cinder-volume[87232]: WARNING cinder.quota [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-817266148 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-817266148, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Created reservations ['9fd4e45a-4585-4964-9acd-a73e03e46b2f', 'ed22b724-bf1f-4c65-b9db-320ae7825035', 'eb12d968-518c-44c4-a48e-6bad8ef30a82', '60b2b237-0afc-4009-a3c9-bd6b9adc1bc5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:41 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f" returned: 0 in 0.369s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc721af7-d0a5-4a16-bd10-c63567826bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c972f6a-11bc-45af-b50f-02bab3a9893f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b115b3c-bc5a-406d-9999-643db6541942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Volume volume-6c972f6a-11bc-45af-b50f-02bab3a9893f (6c972f6a-11bc-45af-b50f-02bab3a9893f): created successfully Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b115b3c-bc5a-406d-9999-643db6541942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Flow 'volume_create_manager' (fbfba096-5b22-40e2-bf01-a49169a2e041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-92a07b76-ccb7-4c46-8931-f52d39927383 tempest-SnapshotMetadataTestJSON-463059163 None] Created volume successfully. Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:41 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:11:41 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:42 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:42 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3c4538e4-2bf7-4dd1-8b09-509468ed3836 tempest-GroupsTest-419697263 None] Delete group completed successfully. Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Creating offline snapshot 38370ae7-942a-4b4d-83e9-eb825da6d49e of volume 6c972f6a-11bc-45af-b50f-02bab3a9893f {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e3a691-4c48-4c57-9e4f-913ed6ccd82a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] Created reservations ['c9534bf3-a25d-45ed-a322-ef6c8f42dfc2'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:43 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f Sep 25 17:11:43 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:43 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:11:43 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:43 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f" returned: 0 in 0.724s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:43 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:43 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:43 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e 1G Sep 25 17:11:43 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-be5490ba-78b9-4307-91e1-e9a988ed0ee4 tempest-GroupsTest-419697263 None] Delete group completed successfully. Sep 25 17:11:44 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e 1G" returned: 0 in 0.880s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c972f6a-11bc-45af-b50f-02bab3a9893f -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:44 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c972f6a-11bc-45af-b50f-02bab3a9893f -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e Sep 25 17:11:44 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-21a0e24b-3e0a-4f80-aac6-feca7114576c tempest-GroupsTest-419697263 None] Group tempest-GroupsTest-Group-1915002760: creating Sep 25 17:11:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-21a0e24b-3e0a-4f80-aac6-feca7114576c tempest-GroupsTest-419697263 None] Group tempest-GroupsTest-Group-1915002760: created successfully Sep 25 17:11:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-21a0e24b-3e0a-4f80-aac6-feca7114576c tempest-GroupsTest-419697263 None] Create group completed successfully. Sep 25 17:11:45 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c972f6a-11bc-45af-b50f-02bab3a9893f -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e" returned: 0 in 0.809s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:45 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e is being set with open permissions: ugo+rw Sep 25 17:11:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:45 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e Sep 25 17:11:45 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:45 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e" returned: 0 in 0.340s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:46 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.info Sep 25 17:11:46 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:46 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.info" returned: 0 in 0.384s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:46 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.info is being set with open permissions: ugo+rw Sep 25 17:11:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:46 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.info Sep 25 17:11:46 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:46 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.info" returned: 0 in 0.427s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.823s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-88e6a455-5487-4c70-8514-3da0e5d6496a tempest-SnapshotMetadataTestJSON-463059163 None] Create snapshot completed successfully Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Flow 'volume_create_manager' (1d70b0d8-8d10-4253-9fd0-21c364e9329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b49fe1e-1009-491a-b3f8-6ce071782f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b49fe1e-1009-491a-b3f8-6ce071782f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1326895301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fd43c2-8fdb-470e-99f6-79a811b1fe79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4e1d443bb04fdf8af991701e3595c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:47Z,use_quota=True,user_id='0698afadd2244f9fbc070bdae76d0308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1ff8d1-745d-4bbf-8282-2384a3e32ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1ff8d1-745d-4bbf-8282-2384a3e32ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01002eed-af97-4c85-9929-cd8d0946ea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01002eed-af97-4c85-9929-cd8d0946ea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67fd43c2-8fdb-470e-99f6-79a811b1fe79', 'volume_name': 'volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcca8a46-3c87-48a3-bae9-1da41fe15313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcca8a46-3c87-48a3-bae9-1da41fe15313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae2078a-dfb6-4955-bf0c-6ccc9393e0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Volume 67fd43c2-8fdb-470e-99f6-79a811b1fe79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79', 'volume_size': 1} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1326895301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fd43c2-8fdb-470e-99f6-79a811b1fe79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4e1d443bb04fdf8af991701e3595c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:47Z,use_quota=True,user_id='0698afadd2244f9fbc070bdae76d0308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Creating volume 67fd43c2-8fdb-470e-99f6-79a811b1fe79 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:47 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:47 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 1073741824 Sep 25 17:11:47 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Flow 'volume_create_manager' (6a925835-ea18-4223-88cd-86f9943e0193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e498fd-48a7-41f5-bdbc-cc7116cdb691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e498fd-48a7-41f5-bdbc-cc7116cdb691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1809908769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6a7abc8-53c8-4a38-a65c-ae66304c1d63,host='devstack@QuobyteHD#QuobyteHD',id=5a4265eb-bcd0-4adb-b7ce-0032260a3e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5eb4ef177c4e9080fdb1f1c49a62f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:48Z,use_quota=True,user_id='10624a120bea48a58612e2b204f8bf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3369496c-0c10-4c83-9645-83cf122dd89e),volume_type_id=3369496c-0c10-4c83-9645-83cf122dd89e)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4ffcf0-f25a-485f-8ddb-b789adb7905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4ffcf0-f25a-485f-8ddb-b789adb7905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f92151-e377-4036-8b40-38df353e9449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f92151-e377-4036-8b40-38df353e9449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4265eb-bcd0-4adb-b7ce-0032260a3e38', 'volume_name': 'volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8e9cb8-109a-4810-8467-9a28b4ff7efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8e9cb8-109a-4810-8467-9a28b4ff7efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913a1f94-577e-4999-b461-39f3daba5884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Volume 5a4265eb-bcd0-4adb-b7ce-0032260a3e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38', 'volume_size': 1} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Flow 'volume_create_manager' (0cacfdc1-d677-4210-9c87-eac454aeed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24ff6a0-0596-4585-ae4c-c86b06a6199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24ff6a0-0596-4585-ae4c-c86b06a6199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915292636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56090291-b16b-4580-82fd-a19b78b7ec2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6862834bc0c849179e9370818f16e619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:48Z,use_quota=True,user_id='0c243dab6d9c401aa516bf25e448ffd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a339cb-d7c2-407d-8774-93fc2e837310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a339cb-d7c2-407d-8774-93fc2e837310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:48 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b5e661-e009-44bd-9774-9fc724101b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b5e661-e009-44bd-9774-9fc724101b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56090291-b16b-4580-82fd-a19b78b7ec2e', 'volume_name': 'volume-56090291-b16b-4580-82fd-a19b78b7ec2e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abe4ccf-99cc-41d1-a338-75e848cb7583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abe4ccf-99cc-41d1-a338-75e848cb7583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6015a9-3fb7-41bd-8197-54f8a2e47e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Volume 56090291-b16b-4580-82fd-a19b78b7ec2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56090291-b16b-4580-82fd-a19b78b7ec2e', 'volume_size': 1} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 1073741824" returned: 0 in 0.866s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:48 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 Sep 25 17:11:48 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Acquiring lock "cinder-38370ae7-942a-4b4d-83e9-eb825da6d49e-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-38370ae7-942a-4b4d-83e9-eb825da6d49e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Acquiring lock "cinder-quobyte-6c972f6a-11bc-45af-b50f-02bab3a9893f" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-quobyte-6c972f6a-11bc-45af-b50f-02bab3a9893f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Acquiring lock "cinder-quobyte-38370ae7-942a-4b4d-83e9-eb825da6d49e" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-quobyte-38370ae7-942a-4b4d-83e9-eb825da6d49e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Deleting offline snapshot 38370ae7-942a-4b4d-83e9-eb825da6d49e of volume 6c972f6a-11bc-45af-b50f-02bab3a9893f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] snapshot_file for this snap is: volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:11:49 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[610d0e2c-6708-4f22-b726-6f0d2ee0d5cf]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79" returned: 0 in 0.441s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f6a7abc8-53c8-4a38-a65c-ae66304c1d63,created_at=2026-09-25T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1809908769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6a7abc8-53c8-4a38-a65c-ae66304c1d63,host='devstack@QuobyteHD#QuobyteHD',id=5a4265eb-bcd0-4adb-b7ce-0032260a3e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5eb4ef177c4e9080fdb1f1c49a62f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:48Z,use_quota=True,user_id='10624a120bea48a58612e2b204f8bf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3369496c-0c10-4c83-9645-83cf122dd89e),volume_type_id=3369496c-0c10-4c83-9645-83cf122dd89e)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Creating volume 5a4265eb-bcd0-4adb-b7ce-0032260a3e38 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:49 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:49 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 1073741824 Sep 25 17:11:49 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae2078a-dfb6-4955-bf0c-6ccc9393e0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ae0f1d-2a8e-40ae-bb47-a886d3b7d942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Volume volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 (67fd43c2-8fdb-470e-99f6-79a811b1fe79): created successfully Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ae0f1d-2a8e-40ae-bb47-a886d3b7d942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Flow 'volume_create_manager' (1d70b0d8-8d10-4253-9fd0-21c364e9329a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:49 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e Sep 25 17:11:49 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8f5643a4-5514-4138-a6b0-ece78266465c tempest-TestMinimumBasicScenario-1753234027 None] Created volume successfully. Sep 25 17:11:49 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e" returned: 0 in 0.545s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c972f6a-11bc-45af-b50f-02bab3a9893f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed90694-ffac-43db-a2f9-147aa72f5ada]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:49 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 1073741824" returned: 0 in 0.705s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:49 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f Sep 25 17:11:49 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:49 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 Sep 25 17:11:50 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:50 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f" returned: 0 in 0.676s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:50 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38" returned: 0 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:50 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.782s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915292636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56090291-b16b-4580-82fd-a19b78b7ec2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6862834bc0c849179e9370818f16e619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:48Z,use_quota=True,user_id='0c243dab6d9c401aa516bf25e448ffd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:50 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Creating volume 56090291-b16b-4580-82fd-a19b78b7ec2e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:50 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:50 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e 1073741824 Sep 25 17:11:50 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913a1f94-577e-4999-b461-39f3daba5884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e7ba59-afb3-42a5-8236-5a767ccd2aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Volume volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 (5a4265eb-bcd0-4adb-b7ce-0032260a3e38): created successfully Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e7ba59-afb3-42a5-8236-5a767ccd2aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Flow 'volume_create_manager' (6a925835-ea18-4223-88cd-86f9943e0193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-da2df18a-6a23-4e0f-ba79-435c544345d3 tempest-GroupsTest-419697263 None] Created volume successfully. Sep 25 17:11:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a478c94a-dde9-404f-88b0-a20cad77d4ed req-7c231c9c-e230-43f7-98f6-641ae7fa4d55 tempest-TestMinimumBasicScenario-1753234027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:51 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e" returned: 0 in 0.630s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:51 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e Sep 25 17:11:51 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:51 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e 1073741824" returned: 0 in 0.639s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:51 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e Sep 25 17:11:51 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:51 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f.38370ae7-942a-4b4d-83e9-eb825da6d49e" returned: 0 in 0.290s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-quobyte-38370ae7-942a-4b4d-83e9-eb825da6d49e" released by "_delete_snapshot" :: held 2.284s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-quobyte-6c972f6a-11bc-45af-b50f-02bab3a9893f" released by "delete_snapshot" :: held 2.313s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Created reservations ['7be2bfc2-0043-4050-8837-e0cc986e9d8d', '709ecaa7-cc4a-4988-a500-bd6d77db7472', '31595a31-3420-4aed-ac88-3b93637154a5', '3bcc6c66-9fb9-4727-a7a2-c80ed0beb3ad'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:51 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e" returned: 0 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a478c94a-dde9-404f-88b0-a20cad77d4ed req-7c231c9c-e230-43f7-98f6-641ae7fa4d55 tempest-TestMinimumBasicScenario-1753234027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.507s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6015a9-3fb7-41bd-8197-54f8a2e47e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56090291-b16b-4580-82fd-a19b78b7ec2e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f24f40-406f-4683-9113-8fdfb4b2246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Volume volume-56090291-b16b-4580-82fd-a19b78b7ec2e (56090291-b16b-4580-82fd-a19b78b7ec2e): created successfully Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f24f40-406f-4683-9113-8fdfb4b2246f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Flow 'volume_create_manager' (0cacfdc1-d677-4210-9c87-eac454aeed1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a478c94a-dde9-404f-88b0-a20cad77d4ed req-7c231c9c-e230-43f7-98f6-641ae7fa4d55 tempest-TestMinimumBasicScenario-1753234027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.147s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8ba54f16-34eb-4b10-897c-3fc7704455eb tempest-VolumesTestJSON-705048395 None] Created volume successfully. Sep 25 17:11:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Delete snapshot completed successfully. Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-a478c94a-dde9-404f-88b0-a20cad77d4ed req-7c231c9c-e230-43f7-98f6-641ae7fa4d55 tempest-TestMinimumBasicScenario-1753234027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2db2bee7-adff-4744-95a9-b5073f6bc764', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:11:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8e54ab59-d1ca-43fa-87ea-7fbb5ce39150 tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-38370ae7-942a-4b4d-83e9-eb825da6d49e-delete_snapshot" released by "delete_snapshot" :: held 2.723s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-a478c94a-dde9-404f-88b0-a20cad77d4ed req-7c231c9c-e230-43f7-98f6-641ae7fa4d55 tempest-TestMinimumBasicScenario-1753234027 None] attachment_update completed successfully. Sep 25 17:11:52 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Flow 'volume_create_manager' (02c09e3f-68cc-4ad5-bbb9-80a158dda14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0615ad-6d6b-4c2f-b3a7-a9379b96664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0615ad-6d6b-4c2f-b3a7-a9379b96664c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1090161698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6a7abc8-53c8-4a38-a65c-ae66304c1d63,host='devstack@QuobyteHD#QuobyteHD',id=8e1d202f-e8ae-4d2d-8a95-de72a32358c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5eb4ef177c4e9080fdb1f1c49a62f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:53Z,use_quota=True,user_id='10624a120bea48a58612e2b204f8bf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3369496c-0c10-4c83-9645-83cf122dd89e),volume_type_id=3369496c-0c10-4c83-9645-83cf122dd89e)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00bd80a-fc35-43c0-9d12-5225bdbb222c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00bd80a-fc35-43c0-9d12-5225bdbb222c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec9d926-2348-4b51-af72-e29405b13243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec9d926-2348-4b51-af72-e29405b13243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1d202f-e8ae-4d2d-8a95-de72a32358c1', 'volume_name': 'volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fcdb94-2d92-458b-8852-562323f92ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fcdb94-2d92-458b-8852-562323f92ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa24aa1-78e8-4ebc-b8ea-14f817be039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Volume 8e1d202f-e8ae-4d2d-8a95-de72a32358c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1', 'volume_size': 1} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f6a7abc8-53c8-4a38-a65c-ae66304c1d63,created_at=2026-09-25T15:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1090161698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6a7abc8-53c8-4a38-a65c-ae66304c1d63,host='devstack@QuobyteHD#QuobyteHD',id=8e1d202f-e8ae-4d2d-8a95-de72a32358c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5eb4ef177c4e9080fdb1f1c49a62f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:53Z,use_quota=True,user_id='10624a120bea48a58612e2b204f8bf76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3369496c-0c10-4c83-9645-83cf122dd89e),volume_type_id=3369496c-0c10-4c83-9645-83cf122dd89e)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Creating volume 8e1d202f-e8ae-4d2d-8a95-de72a32358c1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:53 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:53 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 1073741824 Sep 25 17:11:53 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Acquiring lock "cinder-6c972f6a-11bc-45af-b50f-02bab3a9893f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-6c972f6a-11bc-45af-b50f-02bab3a9893f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Flow 'volume_create_manager' (8f8dc3ad-457b-41a6-b004-c4d26440d1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07094d2a-55d6-4c25-965e-1f9be6596c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07094d2a-55d6-4c25-965e-1f9be6596c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1754153673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e05114-fdb3-4278-89bc-22dfd003e8fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6862834bc0c849179e9370818f16e619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:53Z,use_quota=True,user_id='0c243dab6d9c401aa516bf25e448ffd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc093cd-0bd5-447e-a6bf-7f292785e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc093cd-0bd5-447e-a6bf-7f292785e638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fb5789-9824-4a30-8dda-bba0cee83410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fb5789-9824-4a30-8dda-bba0cee83410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e05114-fdb3-4278-89bc-22dfd003e8fe', 'volume_name': 'volume-87e05114-fdb3-4278-89bc-22dfd003e8fe', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdef9c6-1dfd-48a8-97b5-e4a8e200a31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdef9c6-1dfd-48a8-97b5-e4a8e200a31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5334e3de-99b6-4333-9f7e-a5eed5e65619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Volume 87e05114-fdb3-4278-89bc-22dfd003e8fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e05114-fdb3-4278-89bc-22dfd003e8fe', 'volume_size': 1} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Acquiring lock "cinder-quobyte-6c972f6a-11bc-45af-b50f-02bab3a9893f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-quobyte-6c972f6a-11bc-45af-b50f-02bab3a9893f" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[764ee957-8fe3-427b-8fee-2edc55a3925b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:53 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f Sep 25 17:11:53 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:53 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 1073741824" returned: 0 in 0.703s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:53 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 Sep 25 17:11:53 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:54 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f" returned: 0 in 0.539s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:54 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f Sep 25 17:11:54 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:54 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1" returned: 0 in 0.380s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1754153673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e05114-fdb3-4278-89bc-22dfd003e8fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6862834bc0c849179e9370818f16e619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:53Z,use_quota=True,user_id='0c243dab6d9c401aa516bf25e448ffd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Creating volume 87e05114-fdb3-4278-89bc-22dfd003e8fe {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:54 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa24aa1-78e8-4ebc-b8ea-14f817be039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f331fc81-2ad3-4a95-ad56-bfb305dffc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:54 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe 1073741824 Sep 25 17:11:54 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:54 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Volume volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 (8e1d202f-e8ae-4d2d-8a95-de72a32358c1): created successfully Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f331fc81-2ad3-4a95-ad56-bfb305dffc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Flow 'volume_create_manager' (02c09e3f-68cc-4ad5-bbb9-80a158dda14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d69e5c01-93f2-493c-bdc2-0b86ea614dbe tempest-GroupsTest-419697263 None] Created volume successfully. Sep 25 17:11:54 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6c972f6a-11bc-45af-b50f-02bab3a9893f" returned: 0 in 0.472s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-quobyte-6c972f6a-11bc-45af-b50f-02bab3a9893f" released by "delete_volume" :: held 1.120s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Created reservations ['35bd8996-3f23-443d-9622-eca854d67dd0', '1790420a-63ef-4bf4-8632-bf56682dbbbd', '27c0e9a8-8cee-4497-8ceb-36a30168ab67', 'ad02cacb-09ff-4c40-9647-43bfe5e853a6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:54 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:11:54 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:54 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe 1073741824" returned: 0 in 0.730s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:55 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe Sep 25 17:11:55 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:55 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Deleted volume successfully. Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dd2f04c-9688-4425-a2a0-2cbf6bddad2e tempest-SnapshotMetadataTestJSON-463059163 None] Lock "cinder-6c972f6a-11bc-45af-b50f-02bab3a9893f-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:11:55 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5334e3de-99b6-4333-9f7e-a5eed5e65619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e05114-fdb3-4278-89bc-22dfd003e8fe', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcab939c-fb5b-4ed9-9aaa-864f691eda2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Volume volume-87e05114-fdb3-4278-89bc-22dfd003e8fe (87e05114-fdb3-4278-89bc-22dfd003e8fe): created successfully Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcab939c-fb5b-4ed9-9aaa-864f691eda2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Flow 'volume_create_manager' (8f8dc3ad-457b-41a6-b004-c4d26440d1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3269b054-72d8-4acc-b160-3ea81fd0a70f tempest-VolumesTestJSON-705048395 None] Created volume successfully. Sep 25 17:11:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-123349ce-e7ab-470d-82a6-e0b74b2019d6 tempest-GroupsTest-419697263 None] Update group completed successfully. Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:56 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:11:56 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:56 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:11:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Flow 'volume_create_manager' (5bd9624e-84d9-4370-901e-7b1ac013cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54353ed-4322-4141-8d7e-834404c5a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54353ed-4322-4141-8d7e-834404c5a22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-770086481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35400f7c-6ee7-4ae6-bc01-675d71d5a0b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6862834bc0c849179e9370818f16e619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:57Z,use_quota=True,user_id='0c243dab6d9c401aa516bf25e448ffd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baab207d-a53c-45df-bec2-5f547de6f25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baab207d-a53c-45df-bec2-5f547de6f25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e28449-99cc-48ef-87e6-80a7c7e8bec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e28449-99cc-48ef-87e6-80a7c7e8bec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35400f7c-6ee7-4ae6-bc01-675d71d5a0b2', 'volume_name': 'volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0764aa-12e8-4f80-b9ff-054bb08b75fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0764aa-12e8-4f80-b9ff-054bb08b75fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ee8615-5cd6-422c-9ab0-ff9732b52826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Volume 35400f7c-6ee7-4ae6-bc01-675d71d5a0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2', 'volume_size': 1} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-770086481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35400f7c-6ee7-4ae6-bc01-675d71d5a0b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6862834bc0c849179e9370818f16e619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:11:57Z,use_quota=True,user_id='0c243dab6d9c401aa516bf25e448ffd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Creating volume 35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:11:57 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:11:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:57 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 1073741824 Sep 25 17:11:57 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-43938bb3-937d-4bc0-90e6-3ab05ebdf7b8 tempest-GroupsTest-419697263 None] Update group completed successfully. Sep 25 17:11:58 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 1073741824" returned: 0 in 0.855s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:58 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 Sep 25 17:11:58 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:11:59 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2" returned: 0 in 0.535s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ee8615-5cd6-422c-9ab0-ff9732b52826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb55788-c0fe-42e9-8bd3-7345c162485f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:11:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Volume volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 (35400f7c-6ee7-4ae6-bc01-675d71d5a0b2): created successfully Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb55788-c0fe-42e9-8bd3-7345c162485f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Flow 'volume_create_manager' (5bd9624e-84d9-4370-901e-7b1ac013cb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:11:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4184f4d3-ed54-4399-8c7f-275fa82b6222 tempest-VolumesTestJSON-705048395 None] Created volume successfully. Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Acquiring lock "cinder-quobyte-5a4265eb-bcd0-4adb-b7ce-0032260a3e38" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Lock "cinder-quobyte-5a4265eb-bcd0-4adb-b7ce-0032260a3e38" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebe9424-da86-4d39-9066-21902ce9abb5]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:11:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:11:59 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 Sep 25 17:11:59 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:00 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38" returned: 0 in 0.547s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:00 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38 Sep 25 17:12:00 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:00 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5a4265eb-bcd0-4adb-b7ce-0032260a3e38" returned: 0 in 0.476s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Lock "cinder-quobyte-5a4265eb-bcd0-4adb-b7ce-0032260a3e38" released by "delete_volume" :: held 1.123s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Acquiring lock "cinder-quobyte-8e1d202f-e8ae-4d2d-8a95-de72a32358c1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Lock "cinder-quobyte-8e1d202f-e8ae-4d2d-8a95-de72a32358c1" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e74d9f-f77d-4f46-8d40-2665895d4036]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:01 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 Sep 25 17:12:01 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Acquiring lock "cinder-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Lock "cinder-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Acquiring lock "cinder-quobyte-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Lock "cinder-quobyte-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6f8b56-2e32-4763-a00f-9b952146344a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:01 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1" returned: 0 in 0.797s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:01 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1 Sep 25 17:12:01 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:01 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 Sep 25 17:12:01 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:02 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e1d202f-e8ae-4d2d-8a95-de72a32358c1" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Lock "cinder-quobyte-8e1d202f-e8ae-4d2d-8a95-de72a32358c1" released by "delete_volume" :: held 1.239s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Created reservations ['195601ce-c211-4a14-86c2-592ac8154a7a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:02 devstack cinder-volume[87232]: WARNING cinder.quota [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2121660284 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2121660284, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:12:02 devstack cinder-volume[87232]: WARNING cinder.quota [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2121660284 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2121660284, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:12:02 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Created reservations ['e42088ac-7b0d-41d3-9b42-38fb3f509f8a', '5c3b1ce7-033e-446a-badb-2e11ddb4d4ba', '9a5fcbaa-0f03-45d8-a8f4-58990e444ebe', 'a435f2ab-6db4-4f01-85bf-d6642e45909d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2" returned: 0 in 0.604s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:02 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2 Sep 25 17:12:02 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Created reservations ['cb532a22-cdb1-4bd0-a1c7-4f87213b879b', 'e7a61592-dede-49ef-b17b-11e6deb531e7', '53cf57bc-414d-4145-bd31-fa89064d4d04', '5982b77e-61aa-4174-abe1-87d99dd15ef5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:02 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2" returned: 0 in 0.442s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Lock "cinder-quobyte-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2" released by "delete_volume" :: held 1.165s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:02 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:02 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Created reservations ['5980459b-1e7a-4ae3-9825-62e918f4ef20', '31a044f2-d198-4f3b-a221-45df6f0546b2', '7ccfeb66-ca85-43e5-864e-05c268ffb7cb', '904f2346-c7d2-4914-9b48-755d385cc92e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:02 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:02 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:03 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.377s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-df9b9c40-144e-44b8-a1ad-45b35de744a2 tempest-GroupsTest-419697263 None] Delete group completed successfully. Sep 25 17:12:03 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.334s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Deleted volume successfully. Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d2a3d40-ef36-4a64-8259-1f326ee351b5 tempest-VolumesTestJSON-705048395 None] Lock "cinder-35400f7c-6ee7-4ae6-bc01-675d71d5a0b2-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Acquiring lock "cinder-87e05114-fdb3-4278-89bc-22dfd003e8fe-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Flow 'volume_create_manager' (5a7a590d-fb6a-4333-9e2e-10f754d74ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc81559-d0fa-4729-be18-a6e75de4f685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Lock "cinder-87e05114-fdb3-4278-89bc-22dfd003e8fe-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc81559-d0fa-4729-be18-a6e75de4f685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1639326603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467fd129-694a-4232-89c8-698862e998df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922abfbe1ac84cbdb501a39aece6800e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:04Z,use_quota=True,user_id='2a4ea73033074c97994c459397ef78fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7739cc4a-64fa-4d02-bee3-b1a295518446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7739cc4a-64fa-4d02-bee3-b1a295518446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea2979-7edc-419d-abd6-1625a1758069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daea2979-7edc-419d-abd6-1625a1758069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467fd129-694a-4232-89c8-698862e998df', 'volume_name': 'volume-467fd129-694a-4232-89c8-698862e998df', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ec1eb7-720a-4ad5-852d-3614e827cc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ec1eb7-720a-4ad5-852d-3614e827cc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9f07eb-738c-4c9e-9973-96325b2d9d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Volume 467fd129-694a-4232-89c8-698862e998df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467fd129-694a-4232-89c8-698862e998df', 'volume_size': 1} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1639326603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467fd129-694a-4232-89c8-698862e998df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922abfbe1ac84cbdb501a39aece6800e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:04Z,use_quota=True,user_id='2a4ea73033074c97994c459397ef78fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Creating volume 467fd129-694a-4232-89c8-698862e998df {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:04 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:04 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df 1073741824 Sep 25 17:12:04 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Acquiring lock "cinder-quobyte-87e05114-fdb3-4278-89bc-22dfd003e8fe" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Lock "cinder-quobyte-87e05114-fdb3-4278-89bc-22dfd003e8fe" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef6ed93-d223-4a8f-820a-f03392072bf4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:04 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe Sep 25 17:12:04 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:04 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe" returned: 0 in 0.585s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:04 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df 1073741824" returned: 0 in 0.743s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:04 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe Sep 25 17:12:04 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:04 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df Sep 25 17:12:04 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:05 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87e05114-fdb3-4278-89bc-22dfd003e8fe" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:05 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df" returned: 0 in 0.413s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Lock "cinder-quobyte-87e05114-fdb3-4278-89bc-22dfd003e8fe" released by "delete_volume" :: held 1.162s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9f07eb-738c-4c9e-9973-96325b2d9d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467fd129-694a-4232-89c8-698862e998df', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbe3219-84fa-438b-b470-1f8c81c0662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:05 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Volume volume-467fd129-694a-4232-89c8-698862e998df (467fd129-694a-4232-89c8-698862e998df): created successfully Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbe3219-84fa-438b-b470-1f8c81c0662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Flow 'volume_create_manager' (5a7a590d-fb6a-4333-9e2e-10f754d74ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-660f2999-92d6-4866-8a61-4fd168fc497a tempest-AbsoluteLimitsTests-1748701864 None] Created volume successfully. Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Created reservations ['155b5464-6926-4b3e-b02d-00250e677f54', 'f6713806-af7a-472e-a8a6-213996f01a1d', '67e55f38-48ab-4dc7-b2c0-b95f18c50b5f', '5d452fe3-a4ab-4ca0-8ecc-b997bbdefb15'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:05 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:05 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:05 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Deleted volume successfully. Sep 25 17:12:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718f1f03-ab43-485c-9124-cc9fe59e7a70 tempest-VolumesTestJSON-705048395 None] Lock "cinder-87e05114-fdb3-4278-89bc-22dfd003e8fe-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Acquiring lock "cinder-56090291-b16b-4580-82fd-a19b78b7ec2e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Lock "cinder-56090291-b16b-4580-82fd-a19b78b7ec2e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Acquiring lock "cinder-quobyte-56090291-b16b-4580-82fd-a19b78b7ec2e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Lock "cinder-quobyte-56090291-b16b-4580-82fd-a19b78b7ec2e" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cd6655-ec83-42c5-ad82-e721e3cd88e3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Acquiring lock "cinder-467fd129-694a-4232-89c8-698862e998df-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Lock "cinder-467fd129-694a-4232-89c8-698862e998df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:06 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e Sep 25 17:12:06 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Acquiring lock "cinder-quobyte-467fd129-694a-4232-89c8-698862e998df" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Lock "cinder-quobyte-467fd129-694a-4232-89c8-698862e998df" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[57104996-054c-4318-b848-691fa4feac29]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:06 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df Sep 25 17:12:06 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:06 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e" returned: 0 in 0.464s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:06 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e Sep 25 17:12:06 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:07 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56090291-b16b-4580-82fd-a19b78b7ec2e" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Lock "cinder-quobyte-56090291-b16b-4580-82fd-a19b78b7ec2e" released by "delete_volume" :: held 0.884s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:07 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df" returned: 0 in 0.610s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:07 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df Sep 25 17:12:07 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Created reservations ['fd8d41e2-a9c2-42de-b20f-3435248726d1', '327b10b2-6fcd-4257-be3b-d218bd09bdff', 'cbd1114b-82ff-4358-9b26-5865502d9b58', 'bb01272d-9b74-4dad-a124-e8aae9b8e677'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:07 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:07 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:07 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-467fd129-694a-4232-89c8-698862e998df" returned: 0 in 0.589s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Lock "cinder-quobyte-467fd129-694a-4232-89c8-698862e998df" released by "delete_volume" :: held 1.326s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Created reservations ['de0d455e-3b8a-4b80-a6a4-e77dfbe9c39d', '58623dc6-4a88-48e3-9184-6ee7dc6120e9', '8273a2a7-b316-4baa-9056-43c9e44f3596', '4967c654-54aa-4ae3-8cf3-3eb5bb14bcbf'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:08 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.604s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Deleted volume successfully. Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a38db077-08c0-43ea-a63e-4bab25610db5 tempest-VolumesTestJSON-705048395 None] Lock "cinder-56090291-b16b-4580-82fd-a19b78b7ec2e-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:08 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:08 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:08 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.439s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Deleted volume successfully. Sep 25 17:12:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8abf5f10-d833-4ed3-b47b-59411aec6ce8 tempest-AbsoluteLimitsTests-1748701864 None] Lock "cinder-467fd129-694a-4232-89c8-698862e998df-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Flow 'volume_create_manager' (842c0acf-3886-4d8f-ac41-80c5ddd38469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56afb763-918a-48ce-b6f9-417b2841915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56afb763-918a-48ce-b6f9-417b2841915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1993350635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3404f1e8-6a30-4fef-8ade-b8631366cdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01cf7a86d624ac19449e814fa1848ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:14Z,use_quota=True,user_id='c15e4d24ae5f47c0ae67007354f599ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4462223-8abc-48f7-b29a-f9f9291db632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4462223-8abc-48f7-b29a-f9f9291db632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54d0ffb-4697-4b8f-93a6-425b02ea6421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54d0ffb-4697-4b8f-93a6-425b02ea6421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3404f1e8-6a30-4fef-8ade-b8631366cdf9', 'volume_name': 'volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956841e7-b531-4de2-94ac-1c88508a10bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956841e7-b531-4de2-94ac-1c88508a10bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8850d1f-2fb5-49a8-b8c9-3f85e0eb3fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9', 'volume_size': 1} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1993350635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3404f1e8-6a30-4fef-8ade-b8631366cdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01cf7a86d624ac19449e814fa1848ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:14Z,use_quota=True,user_id='c15e4d24ae5f47c0ae67007354f599ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Creating volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:14 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:12:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:14 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 1073741824 Sep 25 17:12:14 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:15 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 1073741824" returned: 0 in 0.913s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:15 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 Sep 25 17:12:15 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:15 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9" returned: 0 in 0.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8850d1f-2fb5-49a8-b8c9-3f85e0eb3fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6328d9-c5fa-41b8-ad3a-5908524a86bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Volume volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 (3404f1e8-6a30-4fef-8ade-b8631366cdf9): created successfully Sep 25 17:12:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6328d9-c5fa-41b8-ad3a-5908524a86bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Flow 'volume_create_manager' (842c0acf-3886-4d8f-ac41-80c5ddd38469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b79c1061-fffe-4d68-86c0-e8e9f4d28003 tempest-SnapshotsActionsTest-641598738 None] Created volume successfully. Sep 25 17:12:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-95351d23-a2c6-4ad1-a605-2e7516858f37 tempest-GroupsV320Test-1776407649 None] Group tempest-GroupsV320Test-Group-1532105587: creating Sep 25 17:12:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-95351d23-a2c6-4ad1-a605-2e7516858f37 tempest-GroupsV320Test-1776407649 None] Group tempest-GroupsV320Test-Group-1532105587: created successfully Sep 25 17:12:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-95351d23-a2c6-4ad1-a605-2e7516858f37 tempest-GroupsV320Test-1776407649 None] Create group completed successfully. Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Creating offline snapshot 5fd13853-8e74-4a75-af16-3e7f109bcacc of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9eb520-d9d1-492f-9313-9d43e2c9c398]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:17 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 Sep 25 17:12:17 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Flow 'volume_create_manager' (432a6482-85d6-4de7-b5dd-fd3aaf9de221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f82b3d-2a20-438c-9a59-fef553f50da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f82b3d-2a20-438c-9a59-fef553f50da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2067596986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eef8b1f-3a0b-4595-b52c-6817fb544b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23f027bea2a47e1abfd0a89d3fb95a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:18Z,use_quota=True,user_id='2d2ef673be77436c9da20ab8d42024c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea2ded8-49fb-4a63-a0a4-06d0e8b72b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea2ded8-49fb-4a63-a0a4-06d0e8b72b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f920d51-cfbb-4c26-b2ce-85fe850767eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f920d51-cfbb-4c26-b2ce-85fe850767eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eef8b1f-3a0b-4595-b52c-6817fb544b62', 'volume_name': 'volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f41faa7-1ce1-4e4d-9a2c-69ac52235c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f41faa7-1ce1-4e4d-9a2c-69ac52235c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba378cd-d8c6-4441-94ec-036096b8729f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Volume 1eef8b1f-3a0b-4595-b52c-6817fb544b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62', 'volume_size': 1} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:17 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9" returned: 0 in 0.722s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:18 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc 1G Sep 25 17:12:18 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:18 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] Created reservations ['30a8b06b-90ca-4a60-aee7-a55ad1b7b7a5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:18 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc 1G" returned: 0 in 0.712s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:18 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:18 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:18 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:18 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:19 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.400s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:19 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f2f082c5-a0ed-46a1-9bc2-46246edf1eac tempest-GroupsV320Test-1776407649 None] Delete group completed successfully. Sep 25 17:12:19 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.431s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc is being set with open permissions: ugo+rw Sep 25 17:12:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:19 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:19 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:19 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:19 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.info Sep 25 17:12:19 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:19 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.info" returned: 0 in 0.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.info is being set with open permissions: ugo+rw Sep 25 17:12:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:19 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.info Sep 25 17:12:19 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:20 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.info" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.118s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.417s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2067596986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eef8b1f-3a0b-4595-b52c-6817fb544b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23f027bea2a47e1abfd0a89d3fb95a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:18Z,use_quota=True,user_id='2d2ef673be77436c9da20ab8d42024c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Creating volume 1eef8b1f-3a0b-4595-b52c-6817fb544b62 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:20 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:20 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 1073741824 Sep 25 17:12:20 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4797b0fb-3c25-477e-8db8-87115baae89b tempest-SnapshotsActionsTest-641598738 None] Create snapshot completed successfully Sep 25 17:12:20 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 1073741824" returned: 0 in 0.692s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:21 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 Sep 25 17:12:21 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:21 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62" returned: 0 in 0.324s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba378cd-d8c6-4441-94ec-036096b8729f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2dc4d5-afb1-414e-8179-06e3aeb74f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Volume volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 (1eef8b1f-3a0b-4595-b52c-6817fb544b62): created successfully Sep 25 17:12:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2dc4d5-afb1-414e-8179-06e3aeb74f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Flow 'volume_create_manager' (432a6482-85d6-4de7-b5dd-fd3aaf9de221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-266a3b30-4be8-41f7-a231-cbbc35c87e7e tempest-VolumesMetadataTest-1058433490 None] Created volume successfully. Sep 25 17:12:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Creating offline snapshot f5fb904f-a2a9-4833-83b5-b4acb85011aa of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f86b8b-782a-4714-9a8f-a0b3370f044d]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:22 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:22 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Acquiring lock "cinder-1eef8b1f-3a0b-4595-b52c-6817fb544b62-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Lock "cinder-1eef8b1f-3a0b-4595-b52c-6817fb544b62-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:23 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.791s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Acquiring lock "cinder-quobyte-1eef8b1f-3a0b-4595-b52c-6817fb544b62" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:23 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa 1G Sep 25 17:12:23 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Lock "cinder-quobyte-1eef8b1f-3a0b-4595-b52c-6817fb544b62" acquired by "delete_volume" :: waited 0.052s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[471fb4b5-c6d2-4c30-b2cf-1b9826b5471b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:23 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 Sep 25 17:12:23 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:24 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa 1G" returned: 0 in 0.942s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:24 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62" returned: 0 in 0.767s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:24 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa Sep 25 17:12:24 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:24 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62 Sep 25 17:12:24 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:24 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1eef8b1f-3a0b-4595-b52c-6817fb544b62" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Lock "cinder-quobyte-1eef8b1f-3a0b-4595-b52c-6817fb544b62" released by "delete_volume" :: held 1.293s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Created reservations ['c6c69868-09b6-4080-95ba-471ce6f9d52d', '2ea2a257-e0f5-4d03-be52-212cfed0fd61', '969cf8bf-df64-4cd5-b786-85921b4323c6', '25489de4-5085-441e-828d-bdc5dd309803'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:24 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa" returned: 0 in 0.666s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:24 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa is being set with open permissions: ugo+rw Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:25 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa Sep 25 17:12:25 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:25 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:25 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:25 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.380s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:25 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Deleted volume successfully. Sep 25 17:12:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-749c54c6-03b6-4fd3-a97c-898fa5ad78c8 tempest-VolumesMetadataTest-1058433490 None] Lock "cinder-1eef8b1f-3a0b-4595-b52c-6817fb544b62-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:25 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa" returned: 0 in 0.500s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7bfea115-475d-4e51-87e0-0272996158cd tempest-SnapshotsActionsTest-641598738 None] Create snapshot completed successfully Sep 25 17:12:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-f5fb904f-a2a9-4833-83b5-b4acb85011aa-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-f5fb904f-a2a9-4833-83b5-b4acb85011aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-quobyte-f5fb904f-a2a9-4833-83b5-b4acb85011aa" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-f5fb904f-a2a9-4833-83b5-b4acb85011aa" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Deleting offline snapshot f5fb904f-a2a9-4833-83b5-b4acb85011aa of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:12:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] snapshot_file for this snap is: volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:12:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e754f43-5ff9-40c2-a966-2814ef0e4c7f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:27 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa Sep 25 17:12:27 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:27 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa" returned: 0 in 0.640s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cbd393-5a80-4a46-a38d-7b1ea1df44bc]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:27 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:27 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:28 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.645s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:28 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa Sep 25 17:12:28 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:29 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa" returned: 0 in 0.647s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:29 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa Sep 25 17:12:29 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:29 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.f5fb904f-a2a9-4833-83b5-b4acb85011aa" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-f5fb904f-a2a9-4833-83b5-b4acb85011aa" released by "_delete_snapshot" :: held 2.492s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" released by "delete_snapshot" :: held 2.537s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:29 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=130,cinder:UPDATE=152,cinder:INSERT=35,cinder:DELETE=12 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:12:29 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=149,cinder:SELECT=135,cinder:INSERT=32,cinder:DELETE=11 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:12:29 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Created reservations ['6feb6261-6bbd-4db5-9ece-fdbc2e92a668', '80635ab3-ed5b-4eac-b83f-1d35bff79088', '79982b68-48eb-4275-8438-e9f5351beb7d', '27b8a416-16cd-43ba-bd8b-0fcb8cfdda09'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Delete snapshot completed successfully. Sep 25 17:12:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1239c7da-af35-429a-8be5-f1b3e4fa10ec tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-f5fb904f-a2a9-4833-83b5-b4acb85011aa-delete_snapshot" released by "delete_snapshot" :: held 2.817s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Creating offline snapshot 30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a097f3-cd3b-488a-b56e-dd5e99fc2f02]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:31 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:31 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:31 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.415s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:31 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 1G Sep 25 17:12:31 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:32 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 1G" returned: 0 in 0.753s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:32 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 Sep 25 17:12:32 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Flow 'volume_create_manager' (3ad807ac-7af6-4cc1-8a6e-4611197991af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e5d251-15f4-4741-9210-74793c0125db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e5d251-15f4-4741-9210-74793c0125db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1324560646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f0d16bb4f940a9b10a12d4334f20e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:32Z,use_quota=True,user_id='5de96d8dad544fe7bc9cf086e75e1443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074dfada-4d87-47ee-a6b5-e4af8052831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074dfada-4d87-47ee-a6b5-e4af8052831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d542cf4-92ce-4f6c-b9cc-d34d51855b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d542cf4-92ce-4f6c-b9cc-d34d51855b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc', 'volume_name': 'volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fcf9e2-3c6f-4ab9-b1d0-718f5e7295cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fcf9e2-3c6f-4ab9-b1d0-718f5e7295cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6bf09d-d30c-4d37-9e37-9e7565b4cd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Volume 46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc', 'volume_size': 1} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:32 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96" returned: 0 in 0.451s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:32 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 is being set with open permissions: ugo+rw Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:32 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 Sep 25 17:12:32 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:32 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.498s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1324560646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f0d16bb4f940a9b10a12d4334f20e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:32Z,use_quota=True,user_id='5de96d8dad544fe7bc9cf086e75e1443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Creating volume 46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:32 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:12:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:32 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc 1073741824 Sep 25 17:12:32 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-887264d3-cd5c-49f2-978a-4a8ec4790531 tempest-SnapshotsActionsTest-641598738 None] Create snapshot completed successfully Sep 25 17:12:33 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc 1073741824" returned: 0 in 0.519s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:33 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc Sep 25 17:12:33 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:33 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6bf09d-d30c-4d37-9e37-9e7565b4cd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e549b0-630c-4ba7-9783-2936fa055073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Volume volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc (46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc): created successfully Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e549b0-630c-4ba7-9783-2936fa055073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Flow 'volume_create_manager' (3ad807ac-7af6-4cc1-8a6e-4611197991af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-79f3e9e8-012c-43b7-bfbe-e4347589513f tempest-VolumesNegativeTest-466929283 None] Created volume successfully. Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-30b215a1-a0b3-4f5f-800d-74bc4f7a5a96-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-30b215a1-a0b3-4f5f-800d-74bc4f7a5a96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-quobyte-30b215a1-a0b3-4f5f-800d-74bc4f7a5a96" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-30b215a1-a0b3-4f5f-800d-74bc4f7a5a96" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Deleting offline snapshot 30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:12:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] snapshot_file for this snap is: volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:12:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d3aaac-fe47-4809-9176-82cdd287afdd]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:34 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 Sep 25 17:12:34 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:34 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96" returned: 0 in 0.438s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ede9ff-f50e-4325-a52d-8522bad089de]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:34 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:34 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:35 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.534s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:35 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 Sep 25 17:12:35 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:35 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96" returned: 0 in 0.514s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:35 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96 Sep 25 17:12:35 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:35 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.30b215a1-a0b3-4f5f-800d-74bc4f7a5a96" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-30b215a1-a0b3-4f5f-800d-74bc4f7a5a96" released by "_delete_snapshot" :: held 1.974s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" released by "delete_snapshot" :: held 2.004s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:36 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Created reservations ['0256a262-9768-4dc8-8240-cbcaafc662f2', 'b0ac538a-4f47-48dd-b915-f89e7f06b255', '848eb3bc-704b-41d5-a920-3dd4b52eb97d', '924f2124-0ba2-4292-bad4-0676db9081cf'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Delete snapshot completed successfully. Sep 25 17:12:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-22720d1a-f075-4b0f-81c4-e16f00d64319 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-30b215a1-a0b3-4f5f-800d-74bc4f7a5a96-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Creating offline snapshot c948793e-0e3f-4a45-940a-67c74505e596 of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d229d39f-65d7-456b-a218-aca2ec28383f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:38 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:38 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.571s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:38 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:38 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 1G Sep 25 17:12:38 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:39 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 1G" returned: 0 in 0.845s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:39 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 Sep 25 17:12:39 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:39 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:39 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 is being set with open permissions: ugo+rw Sep 25 17:12:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:39 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 Sep 25 17:12:39 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:39 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fffc56ba-ee9b-4428-8aba-98749e8b9fa4 tempest-SnapshotsActionsTest-641598738 None] Create snapshot completed successfully Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-c948793e-0e3f-4a45-940a-67c74505e596-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-c948793e-0e3f-4a45-940a-67c74505e596-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-quobyte-c948793e-0e3f-4a45-940a-67c74505e596" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-c948793e-0e3f-4a45-940a-67c74505e596" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Deleting offline snapshot c948793e-0e3f-4a45-940a-67c74505e596 of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] snapshot_file for this snap is: volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d0c2df-d498-4f79-b1fb-bb147b43d19e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:41 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 Sep 25 17:12:41 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:42 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596" returned: 0 in 0.629s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee735b7-19a8-4024-8159-8804946d0446]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:42 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:42 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:42 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.625s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:42 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 Sep 25 17:12:42 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:43 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596" returned: 0 in 0.902s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:43 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596 Sep 25 17:12:43 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:44 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.c948793e-0e3f-4a45-940a-67c74505e596" returned: 0 in 0.580s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-c948793e-0e3f-4a45-940a-67c74505e596" released by "_delete_snapshot" :: held 2.939s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" released by "delete_snapshot" :: held 2.989s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Created reservations ['2a992d62-47fc-4810-8eea-8bd28d47b96b', 'dfb2cc72-4c2e-4dc4-8fc2-4939e963e47f', '0f363d55-a600-428d-a02a-f60516874226', '6382fa75-5f85-4fa8-9527-4f3fbdad3766'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Delete snapshot completed successfully. Sep 25 17:12:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c77198c6-6dbf-45bd-a53e-d2cfb156b028 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-c948793e-0e3f-4a45-940a-67c74505e596-delete_snapshot" released by "delete_snapshot" :: held 3.264s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Creating offline snapshot 4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:12:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[239392af-ebb3-4166-ab18-a77edbc649cf]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:45 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:45 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:46 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.971s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:46 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 1G Sep 25 17:12:46 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-6023e8c0-c699-430f-ab71-353e133dd673 req-985af52a-3e74-4cc3-8f1c-b46ce757df42 tempest-TestMinimumBasicScenario-1753234027 None] Terminate volume connection completed successfully. Sep 25 17:12:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-6023e8c0-c699-430f-ab71-353e133dd673 req-985af52a-3e74-4cc3-8f1c-b46ce757df42 tempest-TestMinimumBasicScenario-1753234027 None] Deleting attachment 2db2bee7-adff-4744-95a9-b5073f6bc764. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:12:47 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 1G" returned: 0 in 1.039s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:47 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 Sep 25 17:12:47 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:48 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3" returned: 0 in 0.570s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:48 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 is being set with open permissions: ugo+rw Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:48 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 Sep 25 17:12:48 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Acquiring lock "cinder-67fd43c2-8fdb-470e-99f6-79a811b1fe79-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Lock "cinder-67fd43c2-8fdb-470e-99f6-79a811b1fe79-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:48 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3" returned: 0 in 0.509s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Acquiring lock "cinder-quobyte-67fd43c2-8fdb-470e-99f6-79a811b1fe79" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.444s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Lock "cinder-quobyte-67fd43c2-8fdb-470e-99f6-79a811b1fe79" acquired by "delete_volume" :: waited 0.119s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[49718fdb-d1e6-4bfc-818c-05fdcc4df0a0]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c698d90d-58ab-4801-be56-22d99766728f tempest-SnapshotsActionsTest-641598738 None] Create snapshot completed successfully Sep 25 17:12:49 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 Sep 25 17:12:49 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:49 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79" returned: 0 in 0.540s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:49 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79 Sep 25 17:12:49 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:49 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-67fd43c2-8fdb-470e-99f6-79a811b1fe79" returned: 0 in 0.451s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Lock "cinder-quobyte-67fd43c2-8fdb-470e-99f6-79a811b1fe79" released by "delete_volume" :: held 1.106s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Acquiring lock "cinder-quobyte-4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Deleting offline snapshot 4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] snapshot_file for this snap is: volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[00493f13-457f-4786-96f5-b251fd8b9a9f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Created reservations ['81dd9e61-3e31-4d1d-aca1-c2bb69eb85f5', '54f23491-85ac-4d52-8480-cc2357f6804d', 'aa9d3d3d-fc09-4d0f-b333-5d2ccc328df6', 'b1faa8e8-7f96-46eb-a490-142122f4abc5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:50 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:50 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:50 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 Sep 25 17:12:50 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:50 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.477s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Deleted volume successfully. Sep 25 17:12:50 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3" returned: 0 in 0.666s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-24b5e070-b1a0-4151-83f5-f87106fe0325 tempest-TestMinimumBasicScenario-1753234027 None] Lock "cinder-67fd43c2-8fdb-470e-99f6-79a811b1fe79-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b79b072-1b4f-4f62-90d6-18cdb923e23e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:51 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:51 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:51 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.730s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:51 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 Sep 25 17:12:51 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:52 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3" returned: 0 in 0.835s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:52 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3 Sep 25 17:12:52 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:52 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3" returned: 0 in 0.361s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3" released by "_delete_snapshot" :: held 2.794s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" released by "delete_snapshot" :: held 2.841s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:52 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Created reservations ['d68ac3d8-41b4-414d-9281-c953f227d04d', 'f20e8a0e-4614-4c78-b25a-16d639041244', '8d7cf4f6-ea8b-495e-8f85-0a9d57da9036', 'e4f64847-3e12-49bd-a638-fd2c6491caff'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Delete snapshot completed successfully. Sep 25 17:12:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-db400a60-7eb4-41d7-be3a-a727ac6428d1 tempest-SnapshotsActionsTest-150406696 None] Lock "cinder-4e447efa-b61f-4ef2-90f2-eb9cd6d4ece3-delete_snapshot" released by "delete_snapshot" :: held 3.125s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "cinder-5fd13853-8e74-4a75-af16-3e7f109bcacc-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-5fd13853-8e74-4a75-af16-3e7f109bcacc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "cinder-quobyte-5fd13853-8e74-4a75-af16-3e7f109bcacc" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-quobyte-5fd13853-8e74-4a75-af16-3e7f109bcacc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Deleting offline snapshot 5fd13853-8e74-4a75-af16-3e7f109bcacc of volume 3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] snapshot_file for this snap is: volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aa8ddb-eef8-4d20-819f-18868c0facd9]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:54 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:54 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:54 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.532s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4567e1-3608-45fc-8a65-0f130f88d3ef]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:54 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 Sep 25 17:12:54 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:55 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9" returned: 0 in 0.531s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:55 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:55 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:55 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.475s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:55 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc Sep 25 17:12:55 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:56 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9.5fd13853-8e74-4a75-af16-3e7f109bcacc" returned: 0 in 0.395s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:56 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:56 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-quobyte-5fd13853-8e74-4a75-af16-3e7f109bcacc" released by "_delete_snapshot" :: held 2.192s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" released by "delete_snapshot" :: held 2.236s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Created reservations ['f16fa159-cad6-4770-98d0-53916afe4080', '1a2f3297-04f1-483a-b4e6-7a84a2a190e7', '20f54387-351c-4d4e-be68-8848bb7df809', '6ccd08d7-6364-4f33-adec-b8fc16f56284'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:56 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.460s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Delete snapshot completed successfully. Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8dcaa05d-e10a-4cdd-8166-555281d9771c tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-5fd13853-8e74-4a75-af16-3e7f109bcacc-delete_snapshot" released by "delete_snapshot" :: held 2.590s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Flow 'volume_create_manager' (d2b2c71e-170c-4fbf-9cbd-b1334ca1416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82608280-5142-41c3-8165-5ca63ada1f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82608280-5142-41c3-8165-5ca63ada1f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1862090543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84eff8ad70ca4ab1b511ac02f6cc189e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:57Z,use_quota=True,user_id='e5316d5ed1604d56bd3cbab087451714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ec31a5-05b4-4e5e-ae5d-d3b7ce137c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ec31a5-05b4-4e5e-ae5d-d3b7ce137c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca464c27-2f1b-4976-ae60-927650890e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca464c27-2f1b-4976-ae60-927650890e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a', 'volume_name': 'volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3601405-90b1-4f57-a638-c219f322cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3601405-90b1-4f57-a638-c219f322cc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee8ff65-bdbf-4a77-87b0-78b7eb62571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Volume 907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a', 'volume_size': 1} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1862090543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84eff8ad70ca4ab1b511ac02f6cc189e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:12:57Z,use_quota=True,user_id='e5316d5ed1604d56bd3cbab087451714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Creating volume 907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:12:56 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:12:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:56 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a 1073741824 Sep 25 17:12:56 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:57 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a 1073741824" returned: 0 in 0.684s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "cinder-3404f1e8-6a30-4fef-8ade-b8631366cdf9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-3404f1e8-6a30-4fef-8ade-b8631366cdf9-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:57 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a Sep 25 17:12:57 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ee1546-f5e9-4b08-9c3c-3cf17d958554]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:58 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a" returned: 0 in 0.376s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee8ff65-bdbf-4a77-87b0-78b7eb62571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a794d15-2f47-4f2a-a870-6ec351fa6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:12:58 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 Sep 25 17:12:58 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Volume volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a (907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a): created successfully Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a794d15-2f47-4f2a-a870-6ec351fa6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Flow 'volume_create_manager' (d2b2c71e-170c-4fbf-9cbd-b1334ca1416d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:12:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3be7502b-84e5-4c04-8096-418c2023bd95 tempest-VolumesServicesTestJSON-1596883478 None] Created volume successfully. Sep 25 17:12:58 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9" returned: 0 in 0.607s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:58 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9 Sep 25 17:12:58 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:58 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3404f1e8-6a30-4fef-8ade-b8631366cdf9" returned: 0 in 0.415s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-quobyte-3404f1e8-6a30-4fef-8ade-b8631366cdf9" released by "delete_volume" :: held 1.136s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Created reservations ['ff9185a0-03e9-4fec-b7d1-102b95284087', '8087d595-663b-4a35-b7c8-b9084c174a19', 'de51e6b1-8243-483c-a7a0-fc3c331facea', '4d235e5d-89f8-4d49-a959-842eac144772'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:59 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:12:59 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Acquiring lock "cinder-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Lock "cinder-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Acquiring lock "cinder-quobyte-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Lock "cinder-quobyte-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92ab9e7-046b-4455-9b51-36a42562077c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:12:59 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.338s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:12:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Deleted volume successfully. Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-39012c8c-1d41-41b8-9ea8-da5b23aeb418 tempest-SnapshotsActionsTest-641598738 None] Lock "cinder-3404f1e8-6a30-4fef-8ade-b8631366cdf9-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:12:59 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a Sep 25 17:12:59 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:12:59 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a" returned: 0 in 0.524s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:12:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:00 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a Sep 25 17:13:00 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:00 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Lock "cinder-quobyte-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a" released by "delete_volume" :: held 0.956s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Created reservations ['b8eb999b-eb74-4a11-b386-758a6a9e18e5', '33479a16-4ecd-4d34-b55d-eae31cb3a4c6', '1a71c126-cd96-4dc9-b765-95f0ea812024', '6f523e89-c917-4564-b462-9c8505a317b9'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:00 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:13:00 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:00 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Deleted volume successfully. Sep 25 17:13:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c25359b-7527-4ada-b8e9-1ee8d95def49 tempest-VolumesServicesTestJSON-1596883478 None] Lock "cinder-907b1a7c-ac68-41ef-9b3a-8aa083f8fd1a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Acquiring lock "cinder-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Lock "cinder-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Acquiring lock "cinder-quobyte-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Lock "cinder-quobyte-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c49ede-6bca-4c5a-8b27-5c6b51cb0ac2]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:02 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc Sep 25 17:13:02 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:02 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc" returned: 0 in 0.567s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:02 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc Sep 25 17:13:02 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:03 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Lock "cinder-quobyte-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc" released by "delete_volume" :: held 1.039s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Created reservations ['dcbb16f3-b16f-456d-ab62-044229aa2232', '87b959bb-98e8-4066-b167-7020b00bd0fb', '4465ef9b-f6fc-430f-8dc0-837fcb47c801', 'c7c1cdb4-4f81-497d-aacb-3e87481667e9'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:03 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:13:03 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:03 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.288s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Deleted volume successfully. Sep 25 17:13:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-29ad3cbf-f459-494d-acaf-233b3f9449da tempest-VolumesNegativeTest-466929283 None] Lock "cinder-46440cf6-5ac8-4c0c-a0b7-17fdcb30cbfc-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Flow 'volume_create_manager' (c38e4905-cc58-4bf3-af2a-39580dad5919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b275f1b-d42e-4517-89b7-269768fa30d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b275f1b-d42e-4517-89b7-269768fa30d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-836646097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd1d471-e17b-4195-9fef-2f484214d407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004a76a33e12411e85104319a606e02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:12Z,use_quota=True,user_id='49a6150bfb8d440698d393c2ac07879c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab944635-2f92-4d89-a3f1-a5f73ae9bdf7),volume_type_id=ab944635-2f92-4d89-a3f1-a5f73ae9bdf7)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e74bf4-aa05-4a54-b161-a2ed5d84547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e74bf4-aa05-4a54-b161-a2ed5d84547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98741b98-ac70-40f8-bc13-79f2df80fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98741b98-ac70-40f8-bc13-79f2df80fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd1d471-e17b-4195-9fef-2f484214d407', 'volume_name': 'volume-abd1d471-e17b-4195-9fef-2f484214d407', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fa7fd2-6d3a-42e5-b97c-a30ab36948de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fa7fd2-6d3a-42e5-b97c-a30ab36948de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08e09b0-ce26-4e2a-8b88-ca346bb390a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Volume abd1d471-e17b-4195-9fef-2f484214d407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd1d471-e17b-4195-9fef-2f484214d407', 'volume_size': 1} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-836646097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd1d471-e17b-4195-9fef-2f484214d407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004a76a33e12411e85104319a606e02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:12Z,use_quota=True,user_id='49a6150bfb8d440698d393c2ac07879c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab944635-2f92-4d89-a3f1-a5f73ae9bdf7),volume_type_id=ab944635-2f92-4d89-a3f1-a5f73ae9bdf7)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Creating volume abd1d471-e17b-4195-9fef-2f484214d407 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:12 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:13:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:12 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407 1073741824 Sep 25 17:13:12 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:13 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407 1073741824" returned: 0 in 0.842s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:13 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407 Sep 25 17:13:13 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:13 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407" returned: 0 in 0.452s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08e09b0-ce26-4e2a-8b88-ca346bb390a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd1d471-e17b-4195-9fef-2f484214d407', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e2e5c4-3c54-43f5-bd87-6f214fea34d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Volume volume-abd1d471-e17b-4195-9fef-2f484214d407 (abd1d471-e17b-4195-9fef-2f484214d407): created successfully Sep 25 17:13:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e2e5c4-3c54-43f5-bd87-6f214fea34d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Flow 'volume_create_manager' (c38e4905-cc58-4bf3-af2a-39580dad5919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-24aa5f58-5309-4db2-b127-634143ffe4e0 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Created volume successfully. Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Flow 'volume_create_manager' (95125182-75a4-4d33-8b8e-af5be70090a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede30124-d9e0-422c-b711-d5bb20bff0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede30124-d9e0-422c-b711-d5bb20bff0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1265022502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6685723-05e1-4948-a326-8b5fe33bb81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823d0cbaa8ad4bfb87ba411fef4d31e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:14Z,use_quota=True,user_id='1b79d10372c843848b6aa3a1bea75f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06a8c43-af6c-4ff2-b48d-143478535806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06a8c43-af6c-4ff2-b48d-143478535806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ff0f9e-0d2b-4b43-9135-a79665bff011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ff0f9e-0d2b-4b43-9135-a79665bff011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6685723-05e1-4948-a326-8b5fe33bb81b', 'volume_name': 'volume-b6685723-05e1-4948-a326-8b5fe33bb81b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79e9f11-849b-4d78-98f4-000b4495d2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79e9f11-849b-4d78-98f4-000b4495d2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ad82ad-7794-4bf0-bc6f-2ae26dfb810e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Volume b6685723-05e1-4948-a326-8b5fe33bb81b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6685723-05e1-4948-a326-8b5fe33bb81b', 'volume_size': 1} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1265022502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6685723-05e1-4948-a326-8b5fe33bb81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823d0cbaa8ad4bfb87ba411fef4d31e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:14Z,use_quota=True,user_id='1b79d10372c843848b6aa3a1bea75f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Creating volume b6685723-05e1-4948-a326-8b5fe33bb81b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:14 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:14 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b 1073741824 Sep 25 17:13:14 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b4e53790-aa13-4565-bfd9-8edb2b4b258b tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b4e53790-aa13-4565-bfd9-8edb2b4b258b tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b4e53790-aa13-4565-bfd9-8edb2b4b258b tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b4e53790-aa13-4565-bfd9-8edb2b4b258b tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b4e53790-aa13-4565-bfd9-8edb2b4b258b tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4e53790-aa13-4565-bfd9-8edb2b4b258b tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:14 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:13:14 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:15 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4e53790-aa13-4565-bfd9-8edb2b4b258b tempest-VolumeRetypeWithoutMigrationTest-462700093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b4e53790-aa13-4565-bfd9-8edb2b4b258b tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b4e53790-aa13-4565-bfd9-8edb2b4b258b tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Retype volume completed successfully. Sep 25 17:13:15 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b 1073741824" returned: 0 in 0.803s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:15 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b Sep 25 17:13:15 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:15 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ad82ad-7794-4bf0-bc6f-2ae26dfb810e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6685723-05e1-4948-a326-8b5fe33bb81b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4253e2d-6277-4b82-b2f9-326374dde5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Volume volume-b6685723-05e1-4948-a326-8b5fe33bb81b (b6685723-05e1-4948-a326-8b5fe33bb81b): created successfully Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4253e2d-6277-4b82-b2f9-326374dde5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Flow 'volume_create_manager' (95125182-75a4-4d33-8b8e-af5be70090a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f9185fbb-78ad-4e32-a412-c69c38b26e3f tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Created volume successfully. Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Acquiring lock "cinder-abd1d471-e17b-4195-9fef-2f484214d407-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "cinder-abd1d471-e17b-4195-9fef-2f484214d407-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Acquiring lock "cinder-quobyte-abd1d471-e17b-4195-9fef-2f484214d407" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "cinder-quobyte-abd1d471-e17b-4195-9fef-2f484214d407" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27b442-f448-4e67-a972-047b9420aee1]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:16 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407 Sep 25 17:13:16 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Creating offline snapshot 6571d01f-ae5f-4284-985c-3c310c579616 of volume b6685723-05e1-4948-a326-8b5fe33bb81b {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d28d2c-dbc3-4668-bc32-84ac26e264d0]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:16 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407" returned: 0 in 0.544s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:17 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407 Sep 25 17:13:17 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:17 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b Sep 25 17:13:17 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:17 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abd1d471-e17b-4195-9fef-2f484214d407" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "cinder-quobyte-abd1d471-e17b-4195-9fef-2f484214d407" released by "delete_volume" :: held 1.038s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:17 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b" returned: 0 in 0.560s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:17 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 1G Sep 25 17:13:17 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:17 devstack cinder-volume[87232]: WARNING cinder.quota [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:13:17 devstack cinder-volume[87232]: WARNING cinder.quota [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Created reservations ['31fa7371-22bc-41e5-8477-945cb1ac5f16', 'b495ee4b-72f7-4b3c-83b2-bfb086e80807', '133c2405-867e-4ba7-abd1-b27178a15a16', 'd854d1c2-1b86-4839-be2b-7f48d81ed763'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:17 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:13:17 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:18 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:18 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Deleted volume successfully. Sep 25 17:13:18 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3422683a-caee-4d70-ba9f-528f01109c33 tempest-VolumeRetypeWithoutMigrationTest-462700093 None] Lock "cinder-abd1d471-e17b-4195-9fef-2f484214d407-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 1G" returned: 0 in 0.641s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6685723-05e1-4948-a326-8b5fe33bb81b -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:18 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6685723-05e1-4948-a326-8b5fe33bb81b -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 Sep 25 17:13:18 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:18 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6685723-05e1-4948-a326-8b5fe33bb81b -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:18 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 is being set with open permissions: ugo+rw Sep 25 17:13:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:18 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 Sep 25 17:13:18 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:18 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616" returned: 0 in 0.393s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:19 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.info Sep 25 17:13:19 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:19 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.info" returned: 0 in 0.430s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.info is being set with open permissions: ugo+rw Sep 25 17:13:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:19 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.info Sep 25 17:13:19 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:19 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.info" returned: 0 in 0.400s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.053s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1f07ebaf-363a-4876-9205-b52a8546385c tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Create snapshot completed successfully Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Acquiring lock "cinder-6571d01f-ae5f-4284-985c-3c310c579616-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-6571d01f-ae5f-4284-985c-3c310c579616-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Acquiring lock "cinder-quobyte-b6685723-05e1-4948-a326-8b5fe33bb81b" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-quobyte-b6685723-05e1-4948-a326-8b5fe33bb81b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Acquiring lock "cinder-quobyte-6571d01f-ae5f-4284-985c-3c310c579616" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-quobyte-6571d01f-ae5f-4284-985c-3c310c579616" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Deleting offline snapshot 6571d01f-ae5f-4284-985c-3c310c579616 of volume b6685723-05e1-4948-a326-8b5fe33bb81b {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] snapshot_file for this snap is: volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7087b56d-f7d7-445a-bcc3-68a86209f532]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:21 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 Sep 25 17:13:21 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:22 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616" returned: 0 in 0.527s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6685723-05e1-4948-a326-8b5fe33bb81b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:13:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd541ff5-b1e1-4a3b-b31e-7d07c4949895]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:22 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b Sep 25 17:13:22 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:23 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b" returned: 0 in 0.797s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:23 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 Sep 25 17:13:23 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:23 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616" returned: 0 in 0.577s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:23 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616 Sep 25 17:13:23 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:24 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b.6571d01f-ae5f-4284-985c-3c310c579616" returned: 0 in 0.516s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-quobyte-6571d01f-ae5f-4284-985c-3c310c579616" released by "_delete_snapshot" :: held 2.618s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-quobyte-b6685723-05e1-4948-a326-8b5fe33bb81b" released by "delete_snapshot" :: held 2.652s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:24 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Created reservations ['19f19742-8dab-49b2-9d06-b482a677593e', 'da7d354b-e612-46e5-840c-859a74bac5a5', '17328fd5-75d2-4bc7-8f67-9cdf67b9edaf', '2feecc27-36f8-43e6-b91e-c8e230bf68e2'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Delete snapshot completed successfully. Sep 25 17:13:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e6b1495e-2d3f-4785-8389-b536161b7306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-6571d01f-ae5f-4284-985c-3c310c579616-delete_snapshot" released by "delete_snapshot" :: held 2.887s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Acquiring lock "cinder-b6685723-05e1-4948-a326-8b5fe33bb81b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-b6685723-05e1-4948-a326-8b5fe33bb81b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Acquiring lock "cinder-quobyte-b6685723-05e1-4948-a326-8b5fe33bb81b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-quobyte-b6685723-05e1-4948-a326-8b5fe33bb81b" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba4498d-741b-40b2-a327-033bc4cd1f18]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:25 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b Sep 25 17:13:25 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:25 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b" returned: 0 in 0.491s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:25 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b Sep 25 17:13:25 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:26 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b6685723-05e1-4948-a326-8b5fe33bb81b" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-quobyte-b6685723-05e1-4948-a326-8b5fe33bb81b" released by "delete_volume" :: held 0.950s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Created reservations ['39686076-c7e3-440a-a58c-d6aee1203c53', '33f79ab9-ff28-4064-8f82-b782999f6d4f', '8d371988-dbc8-421c-b93a-64452b91cff9', '389c9cc9-f483-4c49-8b32-2e6b4515a78a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:26 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:13:26 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:26 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Deleted volume successfully. Sep 25 17:13:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6622cdd1-3c6e-44db-bdc3-4a0462db59f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1347984323 None] Lock "cinder-b6685723-05e1-4948-a326-8b5fe33bb81b-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:INSERT=28,cinder:UPDATE=101,cinder:SELECT=77,cinder:DELETE=10 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=94,cinder:INSERT=25,cinder:UPDATE=104,cinder:DELETE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Flow 'volume_create_manager' (46c71a61-efc8-492e-b6a4-5e18757f91c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bb45a2-abfb-4fa8-a0c8-478e51f0be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bb45a2-abfb-4fa8-a0c8-478e51f0be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-419727564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb8b2c2-dbd8-4430-aa35-e83bbee5e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a53b106109248309bdbe059ddac0d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:33Z,use_quota=True,user_id='b1acc9a81af748c7bfd529d05ede0d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301179c-1140-4892-adae-8345dcadb4ac),volume_type_id=3301179c-1140-4892-adae-8345dcadb4ac)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ba012a-dcb5-4609-9c24-7a051c476f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ba012a-dcb5-4609-9c24-7a051c476f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f749e359-87fd-4ca3-aef4-7d73566a2a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f749e359-87fd-4ca3-aef4-7d73566a2a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb8b2c2-dbd8-4430-aa35-e83bbee5e79d', 'volume_name': 'volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb290b88-d704-4e07-8373-8c69f7545990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb290b88-d704-4e07-8373-8c69f7545990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f77f1d-bfe5-494f-a55f-7d9a37072ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Volume abb8b2c2-dbd8-4430-aa35-e83bbee5e79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d', 'volume_size': 1} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-419727564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb8b2c2-dbd8-4430-aa35-e83bbee5e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a53b106109248309bdbe059ddac0d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:33Z,use_quota=True,user_id='b1acc9a81af748c7bfd529d05ede0d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301179c-1140-4892-adae-8345dcadb4ac),volume_type_id=3301179c-1140-4892-adae-8345dcadb4ac)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Creating volume abb8b2c2-dbd8-4430-aa35-e83bbee5e79d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:33 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:13:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:33 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d 1073741824 Sep 25 17:13:33 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:34 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d 1073741824" returned: 0 in 0.714s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:34 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d Sep 25 17:13:34 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:34 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d" returned: 0 in 0.346s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f77f1d-bfe5-494f-a55f-7d9a37072ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c81cf9-29f8-4934-903c-54be898975fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Volume volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d (abb8b2c2-dbd8-4430-aa35-e83bbee5e79d): created successfully Sep 25 17:13:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c81cf9-29f8-4934-903c-54be898975fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Flow 'volume_create_manager' (46c71a61-efc8-492e-b6a4-5e18757f91c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6dddbfa7-5f3e-46ab-9e7d-b3cee0c35edd tempest-VolumeTypesAccessTest-825659352 None] Created volume successfully. Sep 25 17:13:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Acquiring lock "cinder-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Lock "cinder-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Acquiring lock "cinder-quobyte-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:13:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Lock "cinder-quobyte-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:13:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b44c5ac-bbae-4c28-9d31-dd78489ed501]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:36 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d Sep 25 17:13:36 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:36 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d" returned: 0 in 0.508s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:36 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d Sep 25 17:13:36 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:36 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d" returned: 0 in 0.474s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Lock "cinder-quobyte-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d" released by "delete_volume" :: held 1.065s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:36 devstack cinder-volume[87232]: WARNING cinder.quota [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1373027517 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1373027517, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:13:36 devstack cinder-volume[87232]: WARNING cinder.quota [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1373027517 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1373027517, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Created reservations ['69931e53-80ae-4d25-b642-3f48ba4e05e7', 'a0001ec0-3b24-4949-883c-6fc7e25e516a', 'e82ab3ff-1eb9-40ed-8fc8-8c8f72bc4741', '6721808e-e948-4b2a-8b76-06862d9ae0bc'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:37 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:13:37 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:37 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Deleted volume successfully. Sep 25 17:13:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-731223ca-99d6-402d-9a3e-6c8bfdd23264 tempest-VolumeTypesAccessTest-825659352 None] Lock "cinder-abb8b2c2-dbd8-4430-aa35-e83bbee5e79d-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Flow 'volume_create_manager' (6a1ee90a-5539-40f5-a727-15ad0ad2dcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fcd547d-5e5d-4ab9-871f-3f7c240d98b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fcd547d-5e5d-4ab9-871f-3f7c240d98b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-114287148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617eb418-8958-4a32-8db5-db0336476757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b51453966354e198ec62aed08bc7411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:42Z,use_quota=True,user_id='c95469f6b03b493a816e525f32cbb2c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e4d864-02e3-41d8-a1eb-a7b795e79494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e4d864-02e3-41d8-a1eb-a7b795e79494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa442a3a-fde5-470c-ad5b-54737f17ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa442a3a-fde5-470c-ad5b-54737f17ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617eb418-8958-4a32-8db5-db0336476757', 'volume_name': 'volume-617eb418-8958-4a32-8db5-db0336476757', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4640bb0e-0fc8-48b1-ba68-5fef69455062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4640bb0e-0fc8-48b1-ba68-5fef69455062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a47f79b-e220-4049-81d3-059dd681325e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Volume 617eb418-8958-4a32-8db5-db0336476757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617eb418-8958-4a32-8db5-db0336476757', 'volume_size': 1} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-114287148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617eb418-8958-4a32-8db5-db0336476757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b51453966354e198ec62aed08bc7411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:13:42Z,use_quota=True,user_id='c95469f6b03b493a816e525f32cbb2c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Creating volume 617eb418-8958-4a32-8db5-db0336476757 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:13:42 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:13:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:42 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 1073741824 Sep 25 17:13:42 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:43 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 1073741824" returned: 0 in 0.629s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:43 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 Sep 25 17:13:43 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:43 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757" returned: 0 in 0.493s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:13:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a47f79b-e220-4049-81d3-059dd681325e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617eb418-8958-4a32-8db5-db0336476757', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ddf7a6-3af7-460a-882d-1f0f61b2c3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:13:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Volume volume-617eb418-8958-4a32-8db5-db0336476757 (617eb418-8958-4a32-8db5-db0336476757): created successfully Sep 25 17:13:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ddf7a6-3af7-460a-882d-1f0f61b2c3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:13:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Flow 'volume_create_manager' (6a1ee90a-5539-40f5-a727-15ad0ad2dcef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:13:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7da0dfe0-5a52-4404-8aef-a31b1c8863d5 tempest-TestImageHashVerification-2009256468 None] Created volume successfully. Sep 25 17:13:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fd380c-6c30-4a8c-85cf-cc4e792349b7]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:46 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 Sep 25 17:13:46 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:46 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757" returned: 0 in 0.500s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d857432-6cc9-412b-87b2-8a1f589f92eb]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:46 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 Sep 25 17:13:46 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:47 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757" returned: 0 in 0.701s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 /opt/stack/data/cinder/conversion/617eb418-8958-4a32-8db5-db0336476757.temp_image.71708ba1-43d8-4e2a-9716-4f08a74dc051v18wid01.img {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:47 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 /opt/stack/data/cinder/conversion/617eb418-8958-4a32-8db5-db0336476757.temp_image.71708ba1-43d8-4e2a-9716-4f08a74dc051v18wid01.img Sep 25 17:13:47 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:53 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=9,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:13:56 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:13:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:13:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:13:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:13:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:13:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:13:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:13:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:56 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:13:56 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:57 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.969s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:57 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:13:57 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:13:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:13:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:13:57 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 /opt/stack/data/cinder/conversion/617eb418-8958-4a32-8db5-db0336476757.temp_image.71708ba1-43d8-4e2a-9716-4f08a74dc051v18wid01.img" returned: 0 in 10.077s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd0b078-9c0f-4011-bf0e-9f86b7ba83c2]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:13:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:13:57 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 Sep 25 17:13:57 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:13:58 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Sep 25 17:13:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757" returned: 0 in 0.706s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:13:58 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757, size 1024.00 MB, duration 10.08 sec, destination /opt/stack/data/cinder/conversion/617eb418-8958-4a32-8db5-db0336476757.temp_image.71708ba1-43d8-4e2a-9716-4f08a74dc051v18wid01.img {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:13:58 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Converted 1024.00 MB image at 101.60 MB/s Sep 25 17:13:58 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] 71708ba1-43d8-4e2a-9716-4f08a74dc051 was raw, no need to convert to raw {{(pid=87232) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 17:14:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Flow 'volume_create_manager' (82898567-00c2-43d4-8a91-d47d97b56882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51096493-e8b9-4270-9181-70f5a7876fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51096493-e8b9-4270-9181-70f5a7876fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1406334156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00c5279-297d-48f3-98dd-c32f1f03ada9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c93c842a7947be9720a82d7211c048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:03Z,use_quota=True,user_id='3cd77587ed3047efb927d29b0742cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718d8af1-76ad-4261-8e23-3bbb10ec6a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718d8af1-76ad-4261-8e23-3bbb10ec6a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2969b51-67b7-43a1-bd70-f74bd88707e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:02 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Flow 'volume_create_manager' (e582adc0-d6f0-41ea-9c9f-9c7f5c4d9723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52658ffa-c6c9-4324-a6fa-e12746f7d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52658ffa-c6c9-4324-a6fa-e12746f7d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-27396232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5325ef8e-2a28-4c53-9939-c2d6fbd4beec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c355686e547f4174a0d75c74f9fc6466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:04Z,use_quota=True,user_id='ce735cb408f94c44b59c40c435bb9795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7b6cfd-8722-41bd-8d4f-6fdb60a9e4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7b6cfd-8722-41bd-8d4f-6fdb60a9e4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac989f56-4a00-4fa7-a237-5af09df157e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac989f56-4a00-4fa7-a237-5af09df157e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5325ef8e-2a28-4c53-9939-c2d6fbd4beec', 'volume_name': 'volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53da3c0f-1f0c-476a-8729-0eb6fae6f6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53da3c0f-1f0c-476a-8729-0eb6fae6f6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635cd4c5-f515-42ee-8466-2a86b8744a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Volume 5325ef8e-2a28-4c53-9939-c2d6fbd4beec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec', 'volume_size': 1} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2969b51-67b7-43a1-bd70-f74bd88707e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f00c5279-297d-48f3-98dd-c32f1f03ada9', 'volume_name': 'volume-f00c5279-297d-48f3-98dd-c32f1f03ada9', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51da11e7-5629-4211-a1ad-d6791a7f0463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51da11e7-5629-4211-a1ad-d6791a7f0463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84705dcb-f8dd-4e75-8e7d-19a5f102ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Volume f00c5279-297d-48f3-98dd-c32f1f03ada9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f00c5279-297d-48f3-98dd-c32f1f03ada9', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:14:03 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Trying to clone f00c5279-297d-48f3-98dd-c32f1f03ada9 from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Flow 'volume_create_manager' (341b754e-1fc8-41c6-a7ff-c88ceef658b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd67b8c0-ccb4-482a-a060-ca4ea5d6eefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd67b8c0-ccb4-482a-a060-ca4ea5d6eefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1406474132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48390760-f652-4cf5-9721-83b3a1b8fd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c355686e547f4174a0d75c74f9fc6466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:04Z,use_quota=True,user_id='ce735cb408f94c44b59c40c435bb9795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ff404d-d383-42d5-a7bc-a355bcac0bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ff404d-d383-42d5-a7bc-a355bcac0bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b73996c-e70e-4ead-82ae-a4f6e57092e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b73996c-e70e-4ead-82ae-a4f6e57092e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48390760-f652-4cf5-9721-83b3a1b8fd0f', 'volume_name': 'volume-48390760-f652-4cf5-9721-83b3a1b8fd0f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f337148c-8fb5-4770-83f8-4fa633bf6c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f337148c-8fb5-4770-83f8-4fa633bf6c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bf1208-da91-43f3-99ff-3adc3c5519a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Volume 48390760-f652-4cf5-9721-83b3a1b8fd0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48390760-f652-4cf5-9721-83b3a1b8fd0f', 'volume_size': 1} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:14:04 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Image download 20.69 MB at 20.69 MB/s Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a56538-271b-4ece-8a06-3211fd912ff7]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:04 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD Sep 25 17:14:04 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:05 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:05 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 is fetched for user 3cd77587ed3047efb927d29b0742cf84. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:14:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a431af-5495-47b3-a3d1-c89be77b5bd3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:05 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD Sep 25 17:14:05 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:05 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD" returned: 0 in 0.510s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:15 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:14:15 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 45.850s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Uploaded volume to glance image-id: 71708ba1-43d8-4e2a-9716-4f08a74dc051. {{(pid=87232) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.103s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-27396232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5325ef8e-2a28-4c53-9939-c2d6fbd4beec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c355686e547f4174a0d75c74f9fc6466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:04Z,use_quota=True,user_id='ce735cb408f94c44b59c40c435bb9795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Creating volume 5325ef8e-2a28-4c53-9939-c2d6fbd4beec {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:31 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:14:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a62af9f9-1dd4-4679-b1f4-68ff3728d82b tempest-TestImageHashVerification-2009256468 None] Copy volume to image completed successfully. Sep 25 17:14:32 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec 1073741824 Sep 25 17:14:32 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:32 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec 1073741824" returned: 0 in 0.708s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:32 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec Sep 25 17:14:32 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:33 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec" returned: 0 in 0.283s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.436s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1406474132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48390760-f652-4cf5-9721-83b3a1b8fd0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c355686e547f4174a0d75c74f9fc6466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:04Z,use_quota=True,user_id='ce735cb408f94c44b59c40c435bb9795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Creating volume 48390760-f652-4cf5-9721-83b3a1b8fd0f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:33 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635cd4c5-f515-42ee-8466-2a86b8744a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:33 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f 1073741824 Sep 25 17:14:33 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ef5c6f-9edf-4f06-a4d1-4195405e2c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Volume volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec (5325ef8e-2a28-4c53-9939-c2d6fbd4beec): created successfully Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ef5c6f-9edf-4f06-a4d1-4195405e2c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Flow 'volume_create_manager' (e582adc0-d6f0-41ea-9c9f-9c7f5c4d9723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-12ad4eb7-52e5-4f1b-bfe3-ae6ea2897e0e tempest-TestServerVolumeAttachmentScenario-280117686 None] Created volume successfully. Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Acquiring lock "cinder-617eb418-8958-4a32-8db5-db0336476757-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Lock "cinder-617eb418-8958-4a32-8db5-db0336476757-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Acquiring lock "cinder-quobyte-617eb418-8958-4a32-8db5-db0336476757" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Lock "cinder-quobyte-617eb418-8958-4a32-8db5-db0336476757" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c9c711-4636-4e22-9de4-a1fe3c84b48a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:33 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 Sep 25 17:14:33 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:33 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f 1073741824" returned: 0 in 0.699s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:33 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f Sep 25 17:14:33 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:34 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757" returned: 0 in 0.478s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:34 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:34 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757 Sep 25 17:14:34 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.158s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1406334156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00c5279-297d-48f3-98dd-c32f1f03ada9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c93c842a7947be9720a82d7211c048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:03Z,use_quota=True,user_id='3cd77587ed3047efb927d29b0742cf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Creating volume f00c5279-297d-48f3-98dd-c32f1f03ada9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:34 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bf1208-da91-43f3-99ff-3adc3c5519a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48390760-f652-4cf5-9721-83b3a1b8fd0f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:34 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 1073741824 Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56032313-cf1e-4996-b422-8b3c12b72b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:34 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Volume volume-48390760-f652-4cf5-9721-83b3a1b8fd0f (48390760-f652-4cf5-9721-83b3a1b8fd0f): created successfully Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56032313-cf1e-4996-b422-8b3c12b72b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Flow 'volume_create_manager' (341b754e-1fc8-41c6-a7ff-c88ceef658b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dce2f243-2cd9-4e24-9f09-52db3f2951df tempest-TestServerVolumeAttachmentScenario-280117686 None] Created volume successfully. Sep 25 17:14:34 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-617eb418-8958-4a32-8db5-db0336476757" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Lock "cinder-quobyte-617eb418-8958-4a32-8db5-db0336476757" released by "delete_volume" :: held 0.874s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Created reservations ['5f42438e-e962-4212-9175-53933f9e302b', 'af83fd94-8d9b-4382-8afe-db23c16bab5f', '514f5135-87f5-4f7b-8058-34add84451db', 'c799d9a4-9517-4244-99c8-c39b2fcd9fe9'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:34 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:14:34 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:34 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 1073741824" returned: 0 in 0.712s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:34 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 Sep 25 17:14:34 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:35 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Deleted volume successfully. Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-21020e1d-a762-466d-8d06-3d1f8f536ef9 tempest-TestImageHashVerification-2009256468 None] Lock "cinder-617eb418-8958-4a32-8db5-db0336476757-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:35 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Attempting download of fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume f00c5279-297d-48f3-98dd-c32f1f03ada9. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a7ead5-90fe-413c-a2f7-44e6c8afaca5]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_7kijy6c2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:35 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_7kijy6c2 Sep 25 17:14:35 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:35 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_7kijy6c2" returned: 0 in 0.439s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_7kijy6c2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:35 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_7kijy6c2 Sep 25 17:14:35 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:36 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_7kijy6c2" returned: 1 in 0.457s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_7kijy6c2' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:14:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa81b0f-023f-4e5d-a372-517c457b5778]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:36 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD Sep 25 17:14:36 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:36 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:36 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] fe054675-e641-4e31-bdb5-5e70f8a00fc9 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:14:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:36 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 Sep 25 17:14:36 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:39 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9" returned: 0 in 2.726s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:39 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_awlc33j0devstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:14:39 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Converted 112.00 MB image at 41.07 MB/s Sep 25 17:14:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:39 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 1G Sep 25 17:14:39 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:39 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 1G" returned: 0 in 0.537s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:39 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Downloaded image fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume f00c5279-297d-48f3-98dd-c32f1f03ada9 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:14:39 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 for user 3cd77587ed3047efb927d29b0742cf84 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:14:39 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Marking volume f00c5279-297d-48f3-98dd-c32f1f03ada9 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:14:39 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Copying metadata from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 to f00c5279-297d-48f3-98dd-c32f1f03ada9. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:14:39 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Creating volume glance metadata for volume f00c5279-297d-48f3-98dd-c32f1f03ada9 backed by image fe054675-e641-4e31-bdb5-5e70f8a00fc9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:14:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84705dcb-f8dd-4e75-8e7d-19a5f102ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00c5279-297d-48f3-98dd-c32f1f03ada9', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ccf164-10f1-4e75-bec7-add8502a264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Volume volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 (f00c5279-297d-48f3-98dd-c32f1f03ada9): created successfully Sep 25 17:14:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ccf164-10f1-4e75-bec7-add8502a264a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Flow 'volume_create_manager' (82898567-00c2-43d4-8a91-d47d97b56882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-beabe6aa-4c05-4002-afa5-4b196d4f2cde tempest-VolumesImageMetadata-281060901 None] Created volume successfully. Sep 25 17:14:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Acquiring lock "cinder-f00c5279-297d-48f3-98dd-c32f1f03ada9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Lock "cinder-f00c5279-297d-48f3-98dd-c32f1f03ada9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Acquiring lock "cinder-quobyte-f00c5279-297d-48f3-98dd-c32f1f03ada9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:14:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Lock "cinder-quobyte-f00c5279-297d-48f3-98dd-c32f1f03ada9" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:14:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ea11bf-cd13-4245-835e-ea0aeff75b5b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:14:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:42 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 Sep 25 17:14:42 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:42 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9" returned: 0 in 0.581s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:42 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9 Sep 25 17:14:42 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:43 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f00c5279-297d-48f3-98dd-c32f1f03ada9" returned: 0 in 0.650s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Lock "cinder-quobyte-f00c5279-297d-48f3-98dd-c32f1f03ada9" released by "delete_volume" :: held 1.311s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Created reservations ['4af3dba8-df34-4f22-9eb5-c50e98a77e4c', 'f92f5477-4882-46e6-8193-afd89e809a50', 'b623050f-c1d4-4f46-8e98-31d001d6eee3', '53b39bb8-3cb5-48e6-a1ea-152af0710267'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:43 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:14:43 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:43 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:43 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Deleted volume successfully. Sep 25 17:14:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e67fcf1b-5812-4762-9e1a-3033a979e0b4 tempest-VolumesImageMetadata-281060901 None] Lock "cinder-f00c5279-297d-48f3-98dd-c32f1f03ada9-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:14:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a105b084-cde9-4163-acdc-eaf9e102d901 req-acf5fdd9-f918-44b1-ba24-b1b74e70c6c9 tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a105b084-cde9-4163-acdc-eaf9e102d901 req-acf5fdd9-f918-44b1-ba24-b1b74e70c6c9 tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-a105b084-cde9-4163-acdc-eaf9e102d901 req-acf5fdd9-f918-44b1-ba24-b1b74e70c6c9 tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-a105b084-cde9-4163-acdc-eaf9e102d901 req-acf5fdd9-f918-44b1-ba24-b1b74e70c6c9 tempest-TestServerVolumeAttachmentScenario-280117686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '431f4510-d48c-48f8-8291-b2e2a11abd25', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:14:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-a105b084-cde9-4163-acdc-eaf9e102d901 req-acf5fdd9-f918-44b1-ba24-b1b74e70c6c9 tempest-TestServerVolumeAttachmentScenario-280117686 None] attachment_update completed successfully. Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:56 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:14:56 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:14:56 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:14:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:14:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-bb441044-8384-4aa6-b26e-c110e6f66a18 req-6e03301f-d429-4b87-ae4f-eec6aae8baff tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-bb441044-8384-4aa6-b26e-c110e6f66a18 req-6e03301f-d429-4b87-ae4f-eec6aae8baff tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-bb441044-8384-4aa6-b26e-c110e6f66a18 req-6e03301f-d429-4b87-ae4f-eec6aae8baff tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-bb441044-8384-4aa6-b26e-c110e6f66a18 req-6e03301f-d429-4b87-ae4f-eec6aae8baff tempest-TestServerVolumeAttachmentScenario-280117686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-48390760-f652-4cf5-9721-83b3a1b8fd0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e023b6c-6c06-4cbb-9fd4-9bbd1710329b', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:14:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-bb441044-8384-4aa6-b26e-c110e6f66a18 req-6e03301f-d429-4b87-ae4f-eec6aae8baff tempest-TestServerVolumeAttachmentScenario-280117686 None] attachment_update completed successfully. Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (f0ea5f3d-4a89-46e6-9081-1daf1ad232ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbe7fc3-c4e1-4778-9d63-02b21a4ac952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bbe7fc3-c4e1-4778-9d63-02b21a4ac952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-421384848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e014668d-ecb4-45f8-80ad-13eaab4b79a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:59Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd77de69-1917-4ebc-85a7-e1501316e186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd77de69-1917-4ebc-85a7-e1501316e186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800d68e1-d96f-4fb6-abc8-bfa68223f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800d68e1-d96f-4fb6-abc8-bfa68223f385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e014668d-ecb4-45f8-80ad-13eaab4b79a5', 'volume_name': 'volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a38b94-d59e-454d-a838-aa3870acac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a38b94-d59e-454d-a838-aa3870acac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec498927-7532-4273-89e1-9d428a407ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:14:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume e014668d-ecb4-45f8-80ad-13eaab4b79a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5', 'volume_size': 1} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-421384848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e014668d-ecb4-45f8-80ad-13eaab4b79a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:14:59Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Creating volume e014668d-ecb4-45f8-80ad-13eaab4b79a5 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:14:59 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:14:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:14:59 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 1073741824 Sep 25 17:14:59 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:00 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 1073741824" returned: 0 in 1.096s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:00 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 Sep 25 17:15:00 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:01 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5" returned: 0 in 0.463s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec498927-7532-4273-89e1-9d428a407ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b284a173-b3b8-4da4-bdf4-0b852070e954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 (e014668d-ecb4-45f8-80ad-13eaab4b79a5): created successfully Sep 25 17:15:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b284a173-b3b8-4da4-bdf4-0b852070e954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (f0ea5f3d-4a89-46e6-9081-1daf1ad232ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a8a3e18d-0937-4bff-9ada-c18ab0d3fdbb tempest-CreateVolumesFromSnapshotTest-816550468 None] Created volume successfully. Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (254c17e1-9e63-4956-9f57-9c15cebd562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7debf3-d51e-4924-aec8-82967cc4f274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7debf3-d51e-4924-aec8-82967cc4f274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17430403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59779ce3-289d-4a8b-ace9-a7e87a370a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:02Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e9add8-5345-4d48-b953-c4a9de216172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e9add8-5345-4d48-b953-c4a9de216172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cefd643-6ddf-417c-9c78-2e332f292fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cefd643-6ddf-417c-9c78-2e332f292fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59779ce3-289d-4a8b-ace9-a7e87a370a17', 'volume_name': 'volume-59779ce3-289d-4a8b-ace9-a7e87a370a17', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e924d62-2848-4538-829b-d5a36dbd5eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e924d62-2848-4538-829b-d5a36dbd5eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd9fb82-412c-4325-b1e5-ee4bfb04ad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Volume 59779ce3-289d-4a8b-ace9-a7e87a370a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59779ce3-289d-4a8b-ace9-a7e87a370a17', 'volume_size': 1} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17430403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59779ce3-289d-4a8b-ace9-a7e87a370a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:02Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Creating volume 59779ce3-289d-4a8b-ace9-a7e87a370a17 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:02 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:02 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 1073741824 Sep 25 17:15:02 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Flow 'volume_create_manager' (89abaee8-145a-4056-9079-225ef31c3cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d28dcc-97a9-4369-85d6-2faabdb5e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d28dcc-97a9-4369-85d6-2faabdb5e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1981935824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1c97a0-36e1-4842-82c5-566fa0397ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1e69f3d1b34ae78cb23552411ca184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:03Z,use_quota=True,user_id='07666e91e2044f19b82eb779221f3c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab246ea-1017-483e-b386-3be89e2ed859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab246ea-1017-483e-b386-3be89e2ed859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c239df7-172f-47a5-91f6-f599e5d4c9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c239df7-172f-47a5-91f6-f599e5d4c9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1c97a0-36e1-4842-82c5-566fa0397ee7', 'volume_name': 'volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a91797a-5c58-46b3-b721-b088e2cf1ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a91797a-5c58-46b3-b721-b088e2cf1ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff667173-1bdc-4387-8bd8-1c35666c5b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Volume 9a1c97a0-36e1-4842-82c5-566fa0397ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7', 'volume_size': 1} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:03 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 1073741824" returned: 0 in 0.983s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:03 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 Sep 25 17:15:03 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-9855a0ed-a931-44a3-8063-f6ba985ba065 req-7cfcba75-05bc-4890-8249-9f40e4943c30 tempest-TestServerVolumeAttachmentScenario-280117686 None] Terminate volume connection completed successfully. Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-9855a0ed-a931-44a3-8063-f6ba985ba065 req-7cfcba75-05bc-4890-8249-9f40e4943c30 tempest-TestServerVolumeAttachmentScenario-280117686 None] Deleting attachment 9e023b6c-6c06-4cbb-9fd4-9bbd1710329b. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:15:03 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1981935824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1c97a0-36e1-4842-82c5-566fa0397ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1e69f3d1b34ae78cb23552411ca184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:03Z,use_quota=True,user_id='07666e91e2044f19b82eb779221f3c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Creating volume 9a1c97a0-36e1-4842-82c5-566fa0397ee7 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:03 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd9fb82-412c-4325-b1e5-ee4bfb04ad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59779ce3-289d-4a8b-ace9-a7e87a370a17', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9b04fc-8bbe-4e8f-a894-760fabbb667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Volume volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 (59779ce3-289d-4a8b-ace9-a7e87a370a17): created successfully Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9b04fc-8bbe-4e8f-a894-760fabbb667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:03 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 1073741824 Sep 25 17:15:03 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (254c17e1-9e63-4956-9f57-9c15cebd562d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-44bbf89f-afe7-4a1d-ad8f-e98ba8607eda tempest-VolumesActionsTest-122577051 None] Created volume successfully. Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-968b2e26-56de-47c9-86ab-0797665c41a7 tempest-VolumesActionsTest-122577051 None] Acquiring lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17" by "attach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-968b2e26-56de-47c9-86ab-0797665c41a7 tempest-VolumesActionsTest-122577051 None] Lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17" acquired by "attach_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-968b2e26-56de-47c9-86ab-0797665c41a7 tempest-VolumesActionsTest-122577051 None] Attaching volume 59779ce3-289d-4a8b-ace9-a7e87a370a17 to instance f6abf8d5-3283-42fa-8215-1c47b67f395a at mountpoint /dev/vdb on host None. Sep 25 17:15:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-968b2e26-56de-47c9-86ab-0797665c41a7 tempest-VolumesActionsTest-122577051 None] Attach volume completed successfully. Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-968b2e26-56de-47c9-86ab-0797665c41a7 tempest-VolumesActionsTest-122577051 None] Lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17" released by "attach_volume" :: held 0.186s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:04 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 1073741824" returned: 0 in 0.789s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:04 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 Sep 25 17:15:04 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:04 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.631s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff667173-1bdc-4387-8bd8-1c35666c5b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc881ac-cdb4-4e3e-b72d-27e6dcc19a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Creating offline snapshot a1f81b52-ba36-4f59-b3ab-747d112bac88 of volume e014668d-ecb4-45f8-80ad-13eaab4b79a5 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:15:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Volume volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 (9a1c97a0-36e1-4842-82c5-566fa0397ee7): created successfully Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc881ac-cdb4-4e3e-b72d-27e6dcc19a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Flow 'volume_create_manager' (89abaee8-145a-4056-9079-225ef31c3cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ac4352-ca2f-4bbf-9582-c851d378f2dc]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f4e2877a-ec70-43c8-9536-03cad6b6f08a tempest-VolumesTransfersTest-996946149 None] Created volume successfully. Sep 25 17:15:05 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 Sep 25 17:15:05 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-426394a7-dc33-40a7-b7ca-3323f65c0ae1 req-7153c851-59f5-4de1-98ef-6490cf3059e4 tempest-TestServerVolumeAttachmentScenario-280117686 None] Terminate volume connection completed successfully. Sep 25 17:15:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-426394a7-dc33-40a7-b7ca-3323f65c0ae1 req-7153c851-59f5-4de1-98ef-6490cf3059e4 tempest-TestServerVolumeAttachmentScenario-280117686 None] Deleting attachment 431f4510-d48c-48f8-8291-b2e2a11abd25. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:15:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5631be7d-f0dd-49ae-9e92-d0b69f903868 tempest-VolumesActionsTest-2033246442 None] Terminate volume connection completed successfully. Sep 25 17:15:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5631be7d-f0dd-49ae-9e92-d0b69f903868 tempest-VolumesActionsTest-2033246442 None] Acquiring lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17-detach_volume" by "detach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5631be7d-f0dd-49ae-9e92-d0b69f903868 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5631be7d-f0dd-49ae-9e92-d0b69f903868 tempest-VolumesActionsTest-2033246442 None] Detaching volume 59779ce3-289d-4a8b-ace9-a7e87a370a17 from instance f6abf8d5-3283-42fa-8215-1c47b67f395a. Sep 25 17:15:05 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5" returned: 0 in 0.627s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:05 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 1G Sep 25 17:15:05 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5631be7d-f0dd-49ae-9e92-d0b69f903868 tempest-VolumesActionsTest-2033246442 None] Detach volume completed successfully. Sep 25 17:15:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5631be7d-f0dd-49ae-9e92-d0b69f903868 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6db28c9b-bf93-45b0-9904-c42933dd8ec9 tempest-VolumesActionsTest-122577051 None] Acquiring lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17-detach_volume" by "detach_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6db28c9b-bf93-45b0-9904-c42933dd8ec9 tempest-VolumesActionsTest-122577051 None] Lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6db28c9b-bf93-45b0-9904-c42933dd8ec9 tempest-VolumesActionsTest-122577051 None] Volume detach called, but volume not attached. Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6db28c9b-bf93-45b0-9904-c42933dd8ec9 tempest-VolumesActionsTest-122577051 None] Lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:06 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 1G" returned: 0 in 0.632s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:06 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 Sep 25 17:15:06 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Acquiring lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Acquiring lock "cinder-quobyte-59779ce3-289d-4a8b-ace9-a7e87a370a17" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Lock "cinder-quobyte-59779ce3-289d-4a8b-ace9-a7e87a370a17" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1f6d80-9484-4a91-97e7-6ad36249ab19]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:06 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88" returned: 0 in 0.528s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:06 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 is being set with open permissions: ugo+rw Sep 25 17:15:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:06 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 Sep 25 17:15:06 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:06 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 Sep 25 17:15:06 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-855a7291-d994-4106-b651-3c88d8c75c9e tempest-VolumesTransfersTest-610545381 None] Transfer volume completed successfully. Sep 25 17:15:07 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17" returned: 0 in 0.802s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:07 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88" returned: 0 in 0.709s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:07 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17 Sep 25 17:15:07 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:07 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.info Sep 25 17:15:07 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:08 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.info" returned: 0 in 0.645s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:08 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.info is being set with open permissions: ugo+rw Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:08 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-59779ce3-289d-4a8b-ace9-a7e87a370a17" returned: 0 in 0.904s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:08 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.info Sep 25 17:15:08 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Lock "cinder-quobyte-59779ce3-289d-4a8b-ace9-a7e87a370a17" released by "delete_volume" :: held 1.823s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Created reservations ['f2b6763b-dcb2-49e8-ae60-2bbb7348ef14', '08a7b08a-4f32-4de4-b9b1-2a5b4bdc64e7', 'f92751f7-1eec-42c5-b83e-bd9902d7081d', '2f90eb60-5102-4a6d-8571-f8b438589bd3'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Acquiring lock "cinder-9a1c97a0-36e1-4842-82c5-566fa0397ee7-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Lock "cinder-9a1c97a0-36e1-4842-82c5-566fa0397ee7-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:09 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:09 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Acquiring lock "cinder-quobyte-9a1c97a0-36e1-4842-82c5-566fa0397ee7" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Lock "cinder-quobyte-9a1c97a0-36e1-4842-82c5-566fa0397ee7" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a79208b-6610-4a22-a637-cfacac0a8ec6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:09 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.info" returned: 0 in 0.919s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.404s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-62e7e33f-1f65-4613-beb9-f2e7180c9051 tempest-CreateVolumesFromSnapshotTest-816550468 None] Create snapshot completed successfully Sep 25 17:15:09 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 Sep 25 17:15:09 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:09 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.821s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Deleted volume successfully. Sep 25 17:15:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b6a9a526-8c02-46ab-8833-73e122c831d2 tempest-VolumesActionsTest-122577051 None] Lock "cinder-59779ce3-289d-4a8b-ace9-a7e87a370a17-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:10 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7" returned: 0 in 1.024s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:10 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7 Sep 25 17:15:10 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:10 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9a1c97a0-36e1-4842-82c5-566fa0397ee7" returned: 0 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Lock "cinder-quobyte-9a1c97a0-36e1-4842-82c5-566fa0397ee7" released by "delete_volume" :: held 1.577s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Created reservations ['52626bd1-eadc-4741-a2a6-deca991316b7', '977f438c-9860-4ad0-a0e4-2658f715e7c9', 'dc93f47b-ca33-4826-a56e-3ee62b0cdd9c', 'a6352757-4c7e-4647-ad66-0084928a1d55'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:11 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:11 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (d97223d1-e3d2-49ee-b2c9-34020f061105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608f437f-ca5f-4b14-a8d3-446082580044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608f437f-ca5f-4b14-a8d3-446082580044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511460042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4d466a-4daa-4d31-9187-10cb925d7fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:11Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd4e020-4958-457e-916b-cd1cc0414ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd4e020-4958-457e-916b-cd1cc0414ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a36588-0679-4d70-9e54-dd2df6333581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a36588-0679-4d70-9e54-dd2df6333581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e4d466a-4daa-4d31-9187-10cb925d7fb6', 'volume_name': 'volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a31c4e-0f43-40aa-82db-81e5e283fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a31c4e-0f43-40aa-82db-81e5e283fb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5b9f39-2c2a-4c04-92e8-ce137c60c1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume 8e4d466a-4daa-4d31-9187-10cb925d7fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6', 'volume_size': 1} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-511460042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4d466a-4daa-4d31-9187-10cb925d7fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:11Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Creating volume 8e4d466a-4daa-4d31-9187-10cb925d7fb6 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:11 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:11 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 1073741824 Sep 25 17:15:11 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:11 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.614s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Deleted volume successfully. Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (21048131-4c00-4743-83ff-1a222996bb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0ac7c9-447e-4a19-ad5b-ff2e2b936878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d9ade2-d0a3-4519-a8d0-16d7a5d14085 tempest-VolumesTransfersTest-99377786 None] Lock "cinder-9a1c97a0-36e1-4842-82c5-566fa0397ee7-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0ac7c9-447e-4a19-ad5b-ff2e2b936878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424149606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:12Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2dd106-4a97-4025-ba01-ac9e682b8791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2dd106-4a97-4025-ba01-ac9e682b8791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96db74a-e899-426d-8c66-7e0e117cee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96db74a-e899-426d-8c66-7e0e117cee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9', 'volume_name': 'volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b56b3a-9790-4634-a642-3e761f63f6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b56b3a-9790-4634-a642-3e761f63f6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6169a3e5-4b2e-4916-9c18-d64fb219fdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9', 'volume_size': 1} Sep 25 17:15:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:12 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 1073741824" returned: 0 in 1.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:12 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 Sep 25 17:15:12 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:13 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6" returned: 0 in 0.484s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (cb928f6b-7c77-47f3-b35f-4a5d10f4f5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcdd05c-b7a4-4db6-93fb-0aa29d009d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424149606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:12Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Creating volume f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:13 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5b9f39-2c2a-4c04-92e8-ce137c60c1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6c1c0e-6108-4b69-8fa8-ebab67c6dd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 1073741824 Sep 25 17:15:13 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcdd05c-b7a4-4db6-93fb-0aa29d009d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64898058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcf5c15-021a-4844-914a-580e908f8ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:13Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c0458a-9c6b-4f14-a635-a8f459e0a033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c0458a-9c6b-4f14-a635-a8f459e0a033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bc5adb-3265-4de4-9f86-7f38d384bc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bc5adb-3265-4de4-9f86-7f38d384bc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcf5c15-021a-4844-914a-580e908f8ca9', 'volume_name': 'volume-5dcf5c15-021a-4844-914a-580e908f8ca9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f824bef7-3911-4d0e-8be4-d575f54488fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f824bef7-3911-4d0e-8be4-d575f54488fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bd185b-0fd8-49d6-a3bf-297839f08561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume 5dcf5c15-021a-4844-914a-580e908f8ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcf5c15-021a-4844-914a-580e908f8ca9', 'volume_size': 1} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 (8e4d466a-4daa-4d31-9187-10cb925d7fb6): created successfully Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6c1c0e-6108-4b69-8fa8-ebab67c6dd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (d97223d1-e3d2-49ee-b2c9-34020f061105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Flow 'volume_create_manager' (1cde9726-0eed-4cd5-a9a4-638a448081e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9c7025-5f31-4df3-94fa-91dc14102f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e9c7025-5f31-4df3-94fa-91dc14102f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1447325726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a625fd-31c9-4cb6-9a46-c2873ce34173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1e69f3d1b34ae78cb23552411ca184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:13Z,use_quota=True,user_id='07666e91e2044f19b82eb779221f3c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be5c42f-6c80-4680-bf1b-15044169ca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be5c42f-6c80-4680-bf1b-15044169ca32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40d8157-3f26-4be7-8b69-6973d9d1d919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40d8157-3f26-4be7-8b69-6973d9d1d919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a625fd-31c9-4cb6-9a46-c2873ce34173', 'volume_name': 'volume-52a625fd-31c9-4cb6-9a46-c2873ce34173', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8166b83c-b7fd-42ad-b62f-4fcbb9b1c35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8166b83c-b7fd-42ad-b62f-4fcbb9b1c35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cf49cb-31c6-447c-9aaf-49bc98d775b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Volume 52a625fd-31c9-4cb6-9a46-c2873ce34173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a625fd-31c9-4cb6-9a46-c2873ce34173', 'volume_size': 1} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-01e7ec89-92c9-483d-bc64-809e1f98ed7c tempest-CreateVolumesFromSnapshotTest-816550468 None] Created volume successfully. Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (593e6b93-bff9-4355-a7a0-f39cbf82bc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c20a4ee-cd6a-4326-84b6-6c792a2ff1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c20a4ee-cd6a-4326-84b6-6c792a2ff1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1647553639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c42121-8121-477a-885e-ac0891dabb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:14Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b0ca0a-7855-458c-9dfc-c4a6ff48eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b0ca0a-7855-458c-9dfc-c4a6ff48eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c161b253-b02a-497f-8255-0801f298e62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c161b253-b02a-497f-8255-0801f298e62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c42121-8121-477a-885e-ac0891dabb23', 'volume_name': 'volume-06c42121-8121-477a-885e-ac0891dabb23', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa7ad17-c6a0-489c-8071-dcc70ff344a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa7ad17-c6a0-489c-8071-dcc70ff344a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9332f99-615e-42c6-aa79-f2b6b749834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:13 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume 06c42121-8121-477a-885e-ac0891dabb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c42121-8121-477a-885e-ac0891dabb23', 'volume_size': 1} Sep 25 17:15:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (867bfe6c-b4e6-4ff1-8e5d-23085028a151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83467a06-cb1f-4100-8257-2a96a2e95f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83467a06-cb1f-4100-8257-2a96a2e95f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1824311520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:14Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524e103e-bf16-443d-b156-c2c579b51ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524e103e-bf16-443d-b156-c2c579b51ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b95b85-1bd2-4418-aab2-3138602f1f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b95b85-1bd2-4418-aab2-3138602f1f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f', 'volume_name': 'volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca66e7e9-4737-4b6f-b263-40d82f5eccc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca66e7e9-4737-4b6f-b263-40d82f5eccc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216971fa-91f1-40ce-8910-55c2b02fbdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume 6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f', 'volume_size': 1} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 1073741824" returned: 0 in 0.929s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:14 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 Sep 25 17:15:14 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (07f35e5d-eae8-49c9-9ecd-f97fa1a3b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755a306f-4b7c-47bb-888f-06a32b4542a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755a306f-4b7c-47bb-888f-06a32b4542a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046521593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27af8344-d8ae-4d59-8e1d-12623e707382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:14Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b44089a-d703-45fb-b028-ac656875f693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b44089a-d703-45fb-b028-ac656875f693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c330c78b-9e1f-431e-a010-1370472de715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c330c78b-9e1f-431e-a010-1370472de715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27af8344-d8ae-4d59-8e1d-12623e707382', 'volume_name': 'volume-27af8344-d8ae-4d59-8e1d-12623e707382', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c2f05d-bb12-4e65-9aca-7b331c65689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c2f05d-bb12-4e65-9aca-7b331c65689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd99e22-14b4-485f-8fe7-497d610bb67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Volume 27af8344-d8ae-4d59-8e1d-12623e707382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27af8344-d8ae-4d59-8e1d-12623e707382', 'volume_size': 1} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:14 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64898058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcf5c15-021a-4844-914a-580e908f8ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:13Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Creating volume 5dcf5c15-021a-4844-914a-580e908f8ca9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:14 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6169a3e5-4b2e-4916-9c18-d64fb219fdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9 1073741824 Sep 25 17:15:14 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0043923-8ee9-4b1d-a843-2433465f64f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 (f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9): created successfully Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0043923-8ee9-4b1d-a843-2433465f64f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (21048131-4c00-4743-83ff-1a222996bb3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c8e4f9ec-e62b-4e32-a980-d1881c258c9e tempest-CreateVolumesFromSnapshotTest-816550468 None] Created volume successfully. Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "cinder-48390760-f652-4cf5-9721-83b3a1b8fd0f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "cinder-48390760-f652-4cf5-9721-83b3a1b8fd0f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "cinder-quobyte-48390760-f652-4cf5-9721-83b3a1b8fd0f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "cinder-quobyte-48390760-f652-4cf5-9721-83b3a1b8fd0f" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4d96ff-0bde-4874-80e0-cab2a6f31d4c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:15 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9 1073741824" returned: 0 in 0.689s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:15 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9 Sep 25 17:15:15 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:15 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f Sep 25 17:15:15 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:15 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9" returned: 0 in 0.281s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1447325726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a625fd-31c9-4cb6-9a46-c2873ce34173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1e69f3d1b34ae78cb23552411ca184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:13Z,use_quota=True,user_id='07666e91e2044f19b82eb779221f3c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Creating volume 52a625fd-31c9-4cb6-9a46-c2873ce34173 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:15 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:15 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 1073741824 Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bd185b-0fd8-49d6-a3bf-297839f08561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcf5c15-021a-4844-914a-580e908f8ca9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:15 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f02b301-1dba-40ca-8ac9-cd259f02a269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume volume-5dcf5c15-021a-4844-914a-580e908f8ca9 (5dcf5c15-021a-4844-914a-580e908f8ca9): created successfully Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f02b301-1dba-40ca-8ac9-cd259f02a269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (cb928f6b-7c77-47f3-b35f-4a5d10f4f5a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:15 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f" returned: 0 in 0.441s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4edb3a93-fc0a-4b45-b178-a1786dfedc0d tempest-CreateVolumesFromSnapshotTest-816550468 None] Created volume successfully. Sep 25 17:15:15 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f Sep 25 17:15:15 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:16 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-48390760-f652-4cf5-9721-83b3a1b8fd0f" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "cinder-quobyte-48390760-f652-4cf5-9721-83b3a1b8fd0f" released by "delete_volume" :: held 0.814s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Created reservations ['b731e6ea-179f-4b04-bc3c-23f50966d174', 'b95ebbf3-00ba-4dce-9d2a-f417e8037f25', 'afa80123-19e9-4d87-848a-a0423df9cbc9', 'b607c488-1d82-41fb-a195-b6e5f6c8586c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:16 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 1073741824" returned: 0 in 0.565s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:16 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:16 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:16 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 Sep 25 17:15:16 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "cinder-5325ef8e-2a28-4c53-9939-c2d6fbd4beec-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "cinder-5325ef8e-2a28-4c53-9939-c2d6fbd4beec-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "cinder-quobyte-5325ef8e-2a28-4c53-9939-c2d6fbd4beec" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "cinder-quobyte-5325ef8e-2a28-4c53-9939-c2d6fbd4beec" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:16 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.313s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Deleted volume successfully. Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bc1d8b-c808-4079-8274-3554e0f598dd]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b1d20735-4dd9-4295-87f5-5b82d34c74f6 tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "cinder-48390760-f652-4cf5-9721-83b3a1b8fd0f-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:16 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173" returned: 0 in 0.399s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.777s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1647553639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c42121-8121-477a-885e-ac0891dabb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:14Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Creating volume 06c42121-8121-477a-885e-ac0891dabb23 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:16 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:16 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec Sep 25 17:15:16 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:16 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23 1073741824 Sep 25 17:15:16 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cf49cb-31c6-447c-9aaf-49bc98d775b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a625fd-31c9-4cb6-9a46-c2873ce34173', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3feaf153-0461-48ac-87c7-9201d6c11acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Volume volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 (52a625fd-31c9-4cb6-9a46-c2873ce34173): created successfully Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3feaf153-0461-48ac-87c7-9201d6c11acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Flow 'volume_create_manager' (1cde9726-0eed-4cd5-a9a4-638a448081e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5affd694-6baf-453d-a799-e9b88f5a903a tempest-VolumesTransfersTest-996946149 None] Created volume successfully. Sep 25 17:15:17 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec" returned: 0 in 0.438s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:17 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec Sep 25 17:15:17 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:17 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23 1073741824" returned: 0 in 0.476s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:17 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23 Sep 25 17:15:17 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:17 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5325ef8e-2a28-4c53-9939-c2d6fbd4beec" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "cinder-quobyte-5325ef8e-2a28-4c53-9939-c2d6fbd4beec" released by "delete_volume" :: held 0.817s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Created reservations ['19dc7562-1a6a-4c0a-b1d1-233ab427909c', '8d265a61-0a90-456f-902a-4e611dab0641', 'a8c94689-367e-4486-b810-b18ca1ddac30', '618c3622-5538-466d-b383-5d871acf100c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:17 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23" returned: 0 in 0.336s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.359s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1824311520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58558a39956b479a84ab0116778b6604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:14Z,use_quota=True,user_id='1385c0b261144f8eaf9247fe4bc3466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Creating volume 6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:17 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:17 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:17 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:17 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f 1073741824 Sep 25 17:15:17 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9332f99-615e-42c6-aa79-f2b6b749834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c42121-8121-477a-885e-ac0891dabb23', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5abf070-2c5e-4f26-b99b-7b866b9d2b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume volume-06c42121-8121-477a-885e-ac0891dabb23 (06c42121-8121-477a-885e-ac0891dabb23): created successfully Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5abf070-2c5e-4f26-b99b-7b866b9d2b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (593e6b93-bff9-4355-a7a0-f39cbf82bc1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-38f38a74-e30b-44ed-8420-394921e8da60 tempest-CreateVolumesFromSnapshotTest-816550468 None] Created volume successfully. Sep 25 17:15:17 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Deleted volume successfully. Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ffa5f423-4845-4299-afd1-952ee0ed063a tempest-TestServerVolumeAttachmentScenario-280117686 None] Lock "cinder-5325ef8e-2a28-4c53-9939-c2d6fbd4beec-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:18 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f 1073741824" returned: 0 in 0.599s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:18 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f Sep 25 17:15:18 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Acquiring lock "cinder-52a625fd-31c9-4cb6-9a46-c2873ce34173-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Lock "cinder-52a625fd-31c9-4cb6-9a46-c2873ce34173-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Acquiring lock "cinder-quobyte-52a625fd-31c9-4cb6-9a46-c2873ce34173" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Lock "cinder-quobyte-52a625fd-31c9-4cb6-9a46-c2873ce34173" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4558268-1e0d-426c-828a-0ee951bd4840]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:18 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f" returned: 0 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.100s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046521593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27af8344-d8ae-4d59-8e1d-12623e707382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:14Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Creating volume 27af8344-d8ae-4d59-8e1d-12623e707382 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:18 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:18 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382 1073741824 Sep 25 17:15:18 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216971fa-91f1-40ce-8910-55c2b02fbdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30629406-6609-49ca-a6c5-be9e37e44a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Volume volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f (6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f): created successfully Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30629406-6609-49ca-a6c5-be9e37e44a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:18 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 Sep 25 17:15:18 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Flow 'volume_create_manager' (867bfe6c-b4e6-4ff1-8e5d-23085028a151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-54e40dd3-7d43-444a-8af0-8b5780b47684 tempest-CreateVolumesFromSnapshotTest-816550468 None] Created volume successfully. Sep 25 17:15:19 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173" returned: 0 in 0.488s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:19 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173 Sep 25 17:15:19 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:19 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382 1073741824" returned: 0 in 0.573s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:19 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382 Sep 25 17:15:19 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:19 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-52a625fd-31c9-4cb6-9a46-c2873ce34173" returned: 0 in 0.307s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Lock "cinder-quobyte-52a625fd-31c9-4cb6-9a46-c2873ce34173" released by "delete_volume" :: held 0.889s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Created reservations ['b622bbdb-7a28-43e5-803d-75c2343b5da1', 'f7843280-6cf9-4328-b69c-e66bab2c7ce8', '5b77af5d-1188-4484-aa1f-d14a1cf83330', '85acb934-2ddf-405a-b84b-9518ddd642c2'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:19 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd99e22-14b4-485f-8fe7-497d610bb67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27af8344-d8ae-4d59-8e1d-12623e707382', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b6ebb4-fdfd-4ecb-b87c-4bbc189a8290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:19 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Volume volume-27af8344-d8ae-4d59-8e1d-12623e707382 (27af8344-d8ae-4d59-8e1d-12623e707382): created successfully Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b6ebb4-fdfd-4ecb-b87c-4bbc189a8290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (07f35e5d-eae8-49c9-9ecd-f97fa1a3b876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9caf75e2-b997-4333-9d8c-d10823ddbf63 tempest-VolumesActionsTest-122577051 None] Created volume successfully. Sep 25 17:15:19 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:19 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-quobyte-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e62d0-43fd-4417-a7bb-1279d8acdd98]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:20 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.413s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Deleted volume successfully. Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Acquiring lock "cinder-27af8344-d8ae-4d59-8e1d-12623e707382-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c64416b-68e2-4ba4-808a-5dd29ba96d73 tempest-VolumesTransfersTest-99377786 None] Lock "cinder-52a625fd-31c9-4cb6-9a46-c2873ce34173-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:20 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f Sep 25 17:15:20 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Lock "cinder-27af8344-d8ae-4d59-8e1d-12623e707382-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Acquiring lock "cinder-quobyte-27af8344-d8ae-4d59-8e1d-12623e707382" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Lock "cinder-quobyte-27af8344-d8ae-4d59-8e1d-12623e707382" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e8c99e-0930-48cb-b662-bc41cc851d62]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:20 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382 Sep 25 17:15:20 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:20 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f" returned: 0 in 0.423s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:20 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f Sep 25 17:15:20 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:20 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:20 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382" returned: 0 in 0.469s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f" released by "delete_volume" :: held 0.809s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:20 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382 Sep 25 17:15:20 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:20 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Created reservations ['4e6da622-ac8b-4933-8301-f4b50ae22ace', '65f78bc0-ae2a-4434-b8c2-4d20ac7118bb', '05310614-3923-4666-ba4f-dc52b8da0d68', '769e421a-6f30-49fe-8b56-7d9797fcad46'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:21 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:21 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:21 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-27af8344-d8ae-4d59-8e1d-12623e707382" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Lock "cinder-quobyte-27af8344-d8ae-4d59-8e1d-12623e707382" released by "delete_volume" :: held 0.862s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-06c42121-8121-477a-885e-ac0891dabb23-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-06c42121-8121-477a-885e-ac0891dabb23-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Created reservations ['fb092a9a-f322-4d14-937d-f0aa2eca0732', '241ad00c-6af8-456f-9751-6f0a50b0b5ce', '25a60384-4fd1-417e-b790-e1068c277240', '60c5150d-03f4-4220-80c0-2d1021db1bf1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-quobyte-06c42121-8121-477a-885e-ac0891dabb23" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-06c42121-8121-477a-885e-ac0891dabb23" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:21 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[650e004a-feed-423a-a4fa-42b2ba40c2d8]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Deleted volume successfully. Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8c8d0bf7-159a-4fa6-a146-c985be7b640c tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-6bf8b280-b5ff-4f3a-9a00-c9e2a30df11f-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:21 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23 Sep 25 17:15:21 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:21 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:21 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:21 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Deleted volume successfully. Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1fa22d76-3096-4077-a32a-c0f342ba6a4c tempest-VolumesActionsTest-2033246442 None] Lock "cinder-27af8344-d8ae-4d59-8e1d-12623e707382-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:21 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23" returned: 0 in 0.545s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:22 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23 Sep 25 17:15:22 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:22 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-06c42121-8121-477a-885e-ac0891dabb23" returned: 0 in 0.293s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-06c42121-8121-477a-885e-ac0891dabb23" released by "delete_volume" :: held 0.924s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Created reservations ['cd1c4409-5b46-415d-b028-f328134d4065', 'd02f9d7a-4de8-488b-9096-0d21dfe69da8', '9749517e-d27e-4179-8c93-148a03a9f8fc', '8ab1b226-c590-438e-af49-1885ea48f528'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-5dcf5c15-021a-4844-914a-580e908f8ca9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:22 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:22 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-5dcf5c15-021a-4844-914a-580e908f8ca9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-quobyte-5dcf5c15-021a-4844-914a-580e908f8ca9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-5dcf5c15-021a-4844-914a-580e908f8ca9" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bd9182-153b-4933-aca6-52bf31f51381]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:22 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:22 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Deleted volume successfully. Sep 25 17:15:22 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9 Sep 25 17:15:22 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c1f83e1-860e-410e-a936-11aee8fd1c68 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-06c42121-8121-477a-885e-ac0891dabb23-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:23 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9" returned: 0 in 0.650s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:23 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9 Sep 25 17:15:23 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (403a45f4-493d-41c9-b211-18f37e23ea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a761bbf-c89d-4ae1-98b6-a222f66ca5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a761bbf-c89d-4ae1-98b6-a222f66ca5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-206183017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08e2a9b-7069-4fc3-b258-e58db9c546de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:24Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261c5aca-bdeb-450f-a4ea-ea551017b9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261c5aca-bdeb-450f-a4ea-ea551017b9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575189bb-692a-496e-8029-f47051c639cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575189bb-692a-496e-8029-f47051c639cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08e2a9b-7069-4fc3-b258-e58db9c546de', 'volume_name': 'volume-d08e2a9b-7069-4fc3-b258-e58db9c546de', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:23 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0333092-a86c-4586-abb2-408fc771de7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0333092-a86c-4586-abb2-408fc771de7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a410af-33cb-4b01-9000-3c4db35c4fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Volume d08e2a9b-7069-4fc3-b258-e58db9c546de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08e2a9b-7069-4fc3-b258-e58db9c546de', 'volume_size': 1} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-206183017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08e2a9b-7069-4fc3-b258-e58db9c546de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:24Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Creating volume d08e2a9b-7069-4fc3-b258-e58db9c546de {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5dcf5c15-021a-4844-914a-580e908f8ca9" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:23 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de 1073741824 Sep 25 17:15:23 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-5dcf5c15-021a-4844-914a-580e908f8ca9" released by "delete_volume" :: held 1.317s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Created reservations ['b875ca74-4c4c-4d47-a25b-37cdccfb3830', '20d732f1-5cef-43fa-9428-dc862b7a5202', '9faf1b79-bd13-4e7b-9f77-9855fa114f45', 'e3cd3782-3c7b-43ee-bd25-43ea775b7bb7'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:24 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:24 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:24 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Deleted volume successfully. Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e5bfac42-8f56-4815-b817-7ac97f846e70 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-5dcf5c15-021a-4844-914a-580e908f8ca9-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:24 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de 1073741824" returned: 0 in 0.721s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:24 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de Sep 25 17:15:24 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-quobyte-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb35169f-7be8-45c1-ac32-1714cade68e5]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:25 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de" returned: 0 in 0.579s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:25 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 Sep 25 17:15:25 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a410af-33cb-4b01-9000-3c4db35c4fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08e2a9b-7069-4fc3-b258-e58db9c546de', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255ae2af-de0f-4604-8fd6-2da2156af608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Volume volume-d08e2a9b-7069-4fc3-b258-e58db9c546de (d08e2a9b-7069-4fc3-b258-e58db9c546de): created successfully Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255ae2af-de0f-4604-8fd6-2da2156af608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (403a45f4-493d-41c9-b211-18f37e23ea09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fcffb8e4-0b0d-4096-870c-bd89832dfeac tempest-VolumesActionsTest-122577051 None] Created volume successfully. Sep 25 17:15:25 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9" returned: 0 in 0.539s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:25 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9 Sep 25 17:15:25 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:26 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9" released by "delete_volume" :: held 1.108s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Acquiring lock "cinder-d08e2a9b-7069-4fc3-b258-e58db9c546de-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-d08e2a9b-7069-4fc3-b258-e58db9c546de-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Created reservations ['68c7fa00-919b-4a69-bd8b-549dbfa76e63', '743a1114-6180-4412-a97c-d3120dca261f', '4b6eb921-82a4-4569-83a1-874e046c618a', '73433459-9f35-4864-8d2c-39edb82bd32e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Acquiring lock "cinder-quobyte-d08e2a9b-7069-4fc3-b258-e58db9c546de" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-quobyte-d08e2a9b-7069-4fc3-b258-e58db9c546de" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd8d896-dd09-4a51-8169-750b35cd0f8b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:26 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:26 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:26 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de Sep 25 17:15:26 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:26 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Deleted volume successfully. Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bd90139c-608a-4d11-a492-25c8c7e310af tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-f5da92bc-ac46-40e5-831d-8eb8bf4ccfb9-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:26 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de" returned: 0 in 0.525s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:26 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de Sep 25 17:15:26 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:27 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d08e2a9b-7069-4fc3-b258-e58db9c546de" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-quobyte-d08e2a9b-7069-4fc3-b258-e58db9c546de" released by "delete_volume" :: held 0.882s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-8e4d466a-4daa-4d31-9187-10cb925d7fb6-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Created reservations ['43cab955-18f6-4fb5-99d0-8c0693b4f24e', '06e72a83-a828-48f4-b141-486333266d65', '36a523a0-a75f-4290-a6db-30a4b92efec1', 'ae03b121-8526-47d6-af7b-baa2d1b37a3c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-8e4d466a-4daa-4d31-9187-10cb925d7fb6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-quobyte-8e4d466a-4daa-4d31-9187-10cb925d7fb6" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-8e4d466a-4daa-4d31-9187-10cb925d7fb6" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f46cef-e2e6-44a0-ab6b-f3292b1dfb9f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:27 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:27 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:27 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 Sep 25 17:15:27 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:27 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Deleted volume successfully. Sep 25 17:15:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-84b85305-75ee-4ec8-8342-c6ef1fc6ff82 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-d08e2a9b-7069-4fc3-b258-e58db9c546de-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:28 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6" returned: 0 in 0.471s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:28 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6 Sep 25 17:15:28 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:28 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8e4d466a-4daa-4d31-9187-10cb925d7fb6" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-8e4d466a-4daa-4d31-9187-10cb925d7fb6" released by "delete_volume" :: held 0.854s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Created reservations ['9557b42b-fe1b-4741-9a11-60834489ff98', '88718c2a-56b1-4dc5-be0b-bc640f669b4b', '73ce6cd7-0c5b-4fe8-8229-1d567fe49eaf', 'cf3e559f-17a3-4e28-8a83-a68344e08bc5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:28 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:28 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (893cb043-3fa4-4cfb-a1b8-66027d704b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1e8423-b29d-4dae-82ef-c065b1639603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:29 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Deleted volume successfully. Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1e8423-b29d-4dae-82ef-c065b1639603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-909456057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec754c50-5db8-4572-bf10-8c4cab2801ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:29Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84863f96-16e2-44b8-ae5e-3ca054ee875f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84863f96-16e2-44b8-ae5e-3ca054ee875f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5af924f-682b-4918-b96e-df9bd894dcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5af924f-682b-4918-b96e-df9bd894dcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec754c50-5db8-4572-bf10-8c4cab2801ea', 'volume_name': 'volume-ec754c50-5db8-4572-bf10-8c4cab2801ea', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c93ce13-be33-41d8-96e4-6995da376a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c93ce13-be33-41d8-96e4-6995da376a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7307b4-85ba-4359-9aba-3630cb2a87fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Volume ec754c50-5db8-4572-bf10-8c4cab2801ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec754c50-5db8-4572-bf10-8c4cab2801ea', 'volume_size': 1} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-909456057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec754c50-5db8-4572-bf10-8c4cab2801ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:29Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Creating volume ec754c50-5db8-4572-bf10-8c4cab2801ea {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:29 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3f88773c-6a8b-4224-ae68-108f72ab581e tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-8e4d466a-4daa-4d31-9187-10cb925d7fb6-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:29 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea 1073741824 Sep 25 17:15:29 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-a1f81b52-ba36-4f59-b3ab-747d112bac88-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-a1f81b52-ba36-4f59-b3ab-747d112bac88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-quobyte-e014668d-ecb4-45f8-80ad-13eaab4b79a5" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-e014668d-ecb4-45f8-80ad-13eaab4b79a5" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-quobyte-a1f81b52-ba36-4f59-b3ab-747d112bac88" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-a1f81b52-ba36-4f59-b3ab-747d112bac88" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Deleting offline snapshot a1f81b52-ba36-4f59-b3ab-747d112bac88 of volume e014668d-ecb4-45f8-80ad-13eaab4b79a5 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] snapshot_file for this snap is: volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cf5195-b34e-469e-b961-ac53e49486fa]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:30 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 Sep 25 17:15:30 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:30 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea 1073741824" returned: 0 in 0.668s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:30 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea Sep 25 17:15:30 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:30 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88" returned: 0 in 0.540s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb2c2e4-7ef1-4cb1-9bff-83eae56c6bdb]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:30 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 Sep 25 17:15:30 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:30 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7307b4-85ba-4359-9aba-3630cb2a87fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec754c50-5db8-4572-bf10-8c4cab2801ea', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf6956b-766b-448d-bde2-956b337f4ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Volume volume-ec754c50-5db8-4572-bf10-8c4cab2801ea (ec754c50-5db8-4572-bf10-8c4cab2801ea): created successfully Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf6956b-766b-448d-bde2-956b337f4ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (893cb043-3fa4-4cfb-a1b8-66027d704b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-edd9651a-672e-47dc-b9da-900d699cda6e tempest-VolumesActionsTest-122577051 None] Created volume successfully. Sep 25 17:15:30 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5" returned: 0 in 0.432s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:30 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 Sep 25 17:15:30 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (82f6325a-136d-490e-99eb-86fc5065276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01991f4-eb74-4325-b5fd-91bc1113c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01991f4-eb74-4325-b5fd-91bc1113c403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1665962027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a8be0e-d530-414e-91f7-b16778c93d77,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:31Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93feb6f4-88e2-42d1-825b-c71833d9edc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93feb6f4-88e2-42d1-825b-c71833d9edc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae836c42-3efb-49d2-83e6-cafb6c985708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae836c42-3efb-49d2-83e6-cafb6c985708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7a8be0e-d530-414e-91f7-b16778c93d77', 'volume_name': 'volume-a7a8be0e-d530-414e-91f7-b16778c93d77', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21198e93-a16e-4b19-9f6c-420f94930115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21198e93-a16e-4b19-9f6c-420f94930115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a5267a-da68-4bf8-81e9-85a27b774996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Volume a7a8be0e-d530-414e-91f7-b16778c93d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7a8be0e-d530-414e-91f7-b16778c93d77', 'volume_size': 1} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1665962027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a8be0e-d530-414e-91f7-b16778c93d77,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:31Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Creating volume a7a8be0e-d530-414e-91f7-b16778c93d77 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:31 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:31 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77 1073741824 Sep 25 17:15:31 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:31 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88" returned: 0 in 0.411s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:31 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88 Sep 25 17:15:31 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:31 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5.a1f81b52-ba36-4f59-b3ab-747d112bac88" returned: 0 in 0.427s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=136,cinder:UPDATE=168,cinder:DELETE=18,cinder:INSERT=40 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=164,cinder:INSERT=46,cinder:SELECT=129,cinder:DELETE=12 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Acquiring lock "cinder-ec754c50-5db8-4572-bf10-8c4cab2801ea-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Lock "cinder-ec754c50-5db8-4572-bf10-8c4cab2801ea-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-a1f81b52-ba36-4f59-b3ab-747d112bac88" released by "_delete_snapshot" :: held 2.056s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:31 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77 1073741824" returned: 0 in 0.737s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-e014668d-ecb4-45f8-80ad-13eaab4b79a5" released by "delete_snapshot" :: held 2.108s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Acquiring lock "cinder-quobyte-ec754c50-5db8-4572-bf10-8c4cab2801ea" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Lock "cinder-quobyte-ec754c50-5db8-4572-bf10-8c4cab2801ea" acquired by "delete_volume" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:32 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77 Sep 25 17:15:32 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fbc473-28a2-40ca-b270-8a5208fee034]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Created reservations ['7c251462-6ae9-4577-ad9e-1ab306f7fbc8', '792f9e90-19bf-44f0-b0aa-b37caafdf09b', '1e6f021d-6b50-4950-a726-8aab61f3435a', '5dcd40e4-9b87-4746-afce-19085f74dd88'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Delete snapshot completed successfully. Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b103cc34-5aa8-440f-9f42-8cd15f2f3971 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-a1f81b52-ba36-4f59-b3ab-747d112bac88-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:32 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea Sep 25 17:15:32 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:32 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77" returned: 0 in 0.334s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a5267a-da68-4bf8-81e9-85a27b774996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a8be0e-d530-414e-91f7-b16778c93d77', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0909f1f-71b6-4141-ab9c-c5ebf0af2b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Volume volume-a7a8be0e-d530-414e-91f7-b16778c93d77 (a7a8be0e-d530-414e-91f7-b16778c93d77): created successfully Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0909f1f-71b6-4141-ab9c-c5ebf0af2b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (82f6325a-136d-490e-99eb-86fc5065276e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0f3e0819-6acd-4ce5-8bd2-856eda8afb75 tempest-VolumesGetTest-1790645599 None] Created volume successfully. Sep 25 17:15:32 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea" returned: 0 in 0.475s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:32 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea Sep 25 17:15:32 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:32 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ec754c50-5db8-4572-bf10-8c4cab2801ea" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Lock "cinder-quobyte-ec754c50-5db8-4572-bf10-8c4cab2801ea" released by "delete_volume" :: held 0.854s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:32 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Created reservations ['73fe3cb9-59c1-4843-b335-85ccc40fd953', '71a6c079-1276-448c-874c-1b10a6c8748a', '0d2c2b2a-0fcd-44c6-8347-eaa59264b522', 'dd92432e-394f-4ecc-9994-e1f00f71a8f0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-e014668d-ecb4-45f8-80ad-13eaab4b79a5-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-e014668d-ecb4-45f8-80ad-13eaab4b79a5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "cinder-quobyte-e014668d-ecb4-45f8-80ad-13eaab4b79a5" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-e014668d-ecb4-45f8-80ad-13eaab4b79a5" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:33 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:33 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb57d261-ce04-4ce4-b59a-cd764bdf9082]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:33 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 Sep 25 17:15:33 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:33 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Deleted volume successfully. Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-10e5c86b-7789-40b0-9453-f98036490abf tempest-VolumesActionsTest-2033246442 None] Lock "cinder-ec754c50-5db8-4572-bf10-8c4cab2801ea-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:33 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5" returned: 0 in 0.532s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:33 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5 Sep 25 17:15:33 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:34 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e014668d-ecb4-45f8-80ad-13eaab4b79a5" returned: 0 in 0.432s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-quobyte-e014668d-ecb4-45f8-80ad-13eaab4b79a5" released by "delete_volume" :: held 1.085s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Created reservations ['db169ce9-03af-4f9a-8f6a-46f4e1bf6da9', '41f211f9-5147-486f-8915-61604f0b4c9c', '5aa9b5fb-5439-4070-b83d-eeedc3a7404b', '1117eeff-0af6-4af3-8ec5-5efb5668e102'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (6531a6fd-692a-4245-9e99-5e33a239aceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac493ec-7129-4e3a-a3c1-0f29efe2c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac493ec-7129-4e3a-a3c1-0f29efe2c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1028742589',display_name='tempest-VolumesGetTest-Volume-2068293049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39415b45-112c-4c7c-9d57-1cafed196565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:34Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b933f5-5503-4940-b591-26ae36561fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b933f5-5503-4940-b591-26ae36561fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03886fbc-0ec7-4971-9e20-9f07f6ccf24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03886fbc-0ec7-4971-9e20-9f07f6ccf24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39415b45-112c-4c7c-9d57-1cafed196565', 'volume_name': 'volume-39415b45-112c-4c7c-9d57-1cafed196565', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78922036-326e-416c-8285-25ae6b492868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78922036-326e-416c-8285-25ae6b492868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0c753a-10ae-4871-a432-75a1f7b82617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Volume 39415b45-112c-4c7c-9d57-1cafed196565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39415b45-112c-4c7c-9d57-1cafed196565', 'volume_size': 1} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1028742589',display_name='tempest-VolumesGetTest-Volume-2068293049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39415b45-112c-4c7c-9d57-1cafed196565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:34Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Creating volume 39415b45-112c-4c7c-9d57-1cafed196565 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:34 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:34 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565 1073741824 Sep 25 17:15:34 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:34 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:34 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (fae118d0-2d3d-43d1-a27e-aa4609f6a70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68917936-a17d-464a-9cb3-263597bb7f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68917936-a17d-464a-9cb3-263597bb7f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-439799519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36807f38-f3ee-4772-b980-b92ee7eb558e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:35Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7540c9a-dae9-4e22-b277-b5346b78a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7540c9a-dae9-4e22-b277-b5346b78a473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28af8eef-2dd8-42da-9303-a2059250776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28af8eef-2dd8-42da-9303-a2059250776a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36807f38-f3ee-4772-b980-b92ee7eb558e', 'volume_name': 'volume-36807f38-f3ee-4772-b980-b92ee7eb558e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383fec60-9d87-4a78-b51a-5263a57d456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383fec60-9d87-4a78-b51a-5263a57d456b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c4ee50-aa53-464a-8ddd-40dac71ae21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Volume 36807f38-f3ee-4772-b980-b92ee7eb558e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36807f38-f3ee-4772-b980-b92ee7eb558e', 'volume_size': 1} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.391s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:34 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Deleted volume successfully. Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-62eecb68-7351-45ad-bc00-a9be4dc06008 tempest-CreateVolumesFromSnapshotTest-816550468 None] Lock "cinder-e014668d-ecb4-45f8-80ad-13eaab4b79a5-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:35 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565 1073741824" returned: 0 in 0.616s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:35 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565 Sep 25 17:15:35 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:35 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565" returned: 0 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-439799519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36807f38-f3ee-4772-b980-b92ee7eb558e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:35Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Creating volume 36807f38-f3ee-4772-b980-b92ee7eb558e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:35 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0c753a-10ae-4871-a432-75a1f7b82617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39415b45-112c-4c7c-9d57-1cafed196565', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:35 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e 1073741824 Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d459e584-e815-4068-b15b-c87536400052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:35 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Volume volume-39415b45-112c-4c7c-9d57-1cafed196565 (39415b45-112c-4c7c-9d57-1cafed196565): created successfully Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d459e584-e815-4068-b15b-c87536400052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (6531a6fd-692a-4245-9e99-5e33a239aceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b50f4111-f7b7-49ce-8f3a-2e26809d333d tempest-VolumesGetTest-1790645599 None] Created volume successfully. Sep 25 17:15:36 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e 1073741824" returned: 0 in 0.580s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:36 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e Sep 25 17:15:36 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:36 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c4ee50-aa53-464a-8ddd-40dac71ae21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36807f38-f3ee-4772-b980-b92ee7eb558e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde8fa7e-8f94-41d7-9e59-7613a32935de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Volume volume-36807f38-f3ee-4772-b980-b92ee7eb558e (36807f38-f3ee-4772-b980-b92ee7eb558e): created successfully Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde8fa7e-8f94-41d7-9e59-7613a32935de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (fae118d0-2d3d-43d1-a27e-aa4609f6a70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-902e8179-33c1-4c7f-a02b-48758c3e078a tempest-VolumesActionsTest-122577051 None] Created volume successfully. Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-39415b45-112c-4c7c-9d57-1cafed196565-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Lock "cinder-39415b45-112c-4c7c-9d57-1cafed196565-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-quobyte-39415b45-112c-4c7c-9d57-1cafed196565" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-39415b45-112c-4c7c-9d57-1cafed196565" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95780f8-38fa-4a93-93e0-9fdd648009b8]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:36 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565 Sep 25 17:15:36 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Acquiring lock "cinder-36807f38-f3ee-4772-b980-b92ee7eb558e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-36807f38-f3ee-4772-b980-b92ee7eb558e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Acquiring lock "cinder-quobyte-36807f38-f3ee-4772-b980-b92ee7eb558e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-quobyte-36807f38-f3ee-4772-b980-b92ee7eb558e" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb075db4-20ea-4526-a510-855bc9bc8d9c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:37 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565" returned: 0 in 0.612s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:37 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565 Sep 25 17:15:37 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:37 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e Sep 25 17:15:37 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:37 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-39415b45-112c-4c7c-9d57-1cafed196565" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-39415b45-112c-4c7c-9d57-1cafed196565" released by "delete_volume" :: held 1.007s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Created reservations ['96eb488a-88de-4b1b-8d85-43253becf11b', '00c3b4c7-36b8-4ea4-89cb-58a753af5f26', '9a370546-dc5c-4a51-a3bb-3e4b469ed9c6', 'c43e8ae2-eb7e-4692-973e-d644db9c6350'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:37 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e" returned: 0 in 0.559s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:38 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e Sep 25 17:15:38 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:38 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:38 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:38 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-36807f38-f3ee-4772-b980-b92ee7eb558e" returned: 0 in 0.391s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-quobyte-36807f38-f3ee-4772-b980-b92ee7eb558e" released by "delete_volume" :: held 1.015s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Created reservations ['d8a80108-b34d-4b7e-8214-13fb23b548fb', '75c6a80c-2d01-4634-aba8-7a89adb00e63', '292761bd-3387-47b3-9d3f-6b5e21bb393c', 'c6e46c12-cb83-44a1-9e9f-428e7f95a96e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:38 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.429s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Deleted volume successfully. Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ed990de5-269c-4036-9b2e-18a51cd26f56 tempest-VolumesGetTest-1790645599 None] Lock "cinder-39415b45-112c-4c7c-9d57-1cafed196565-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:38 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:38 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:38 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.351s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:38 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Deleted volume successfully. Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-33c9a2b3-a223-4c9f-b060-86b105c77538 tempest-VolumesActionsTest-2033246442 None] Lock "cinder-36807f38-f3ee-4772-b980-b92ee7eb558e-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-a7a8be0e-d530-414e-91f7-b16778c93d77-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Lock "cinder-a7a8be0e-d530-414e-91f7-b16778c93d77-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-quobyte-a7a8be0e-d530-414e-91f7-b16778c93d77" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-a7a8be0e-d530-414e-91f7-b16778c93d77" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d8b727-f806-4e30-8158-9f6cf4f1e080]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:39 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77 Sep 25 17:15:39 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (0368d927-2d9c-41ca-b158-36c7b5e97029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27856db5-f864-4b89-8736-b29121cc0c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27856db5-f864-4b89-8736-b29121cc0c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712415654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96def317-fdac-4dbb-bf4e-0e7eee812c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:40Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc05de07-88ad-44df-84d3-231c4bbd03ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc05de07-88ad-44df-84d3-231c4bbd03ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7ecd26-1682-438f-ba9d-c3932eead8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7ecd26-1682-438f-ba9d-c3932eead8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96def317-fdac-4dbb-bf4e-0e7eee812c9b', 'volume_name': 'volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8730afa-6fde-4436-85ad-bf6dcd8657d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8730afa-6fde-4436-85ad-bf6dcd8657d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab70dbb5-553e-4847-a64f-bf32b5fe36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume 96def317-fdac-4dbb-bf4e-0e7eee812c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b', 'volume_size': 1} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712415654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96def317-fdac-4dbb-bf4e-0e7eee812c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:40Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Creating volume 96def317-fdac-4dbb-bf4e-0e7eee812c9b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:39 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:39 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b 1073741824 Sep 25 17:15:39 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:39 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77" returned: 0 in 0.543s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:39 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77 Sep 25 17:15:39 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:40 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7a8be0e-d530-414e-91f7-b16778c93d77" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-a7a8be0e-d530-414e-91f7-b16778c93d77" released by "delete_volume" :: held 1.011s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Created reservations ['74156a60-18fa-4ce3-8f77-9fd089ec8edb', '8523aada-4734-4ab4-b518-f9e4213c3b19', '116b63f4-49d8-476a-9259-2288aaa98fb5', '8c57c9ee-dfdd-444c-a29a-eff54230257c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:40 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b 1073741824" returned: 0 in 0.644s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (b697097e-8d13-48cd-8f31-1aef6e2cc1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa132be0-cea8-4296-88f2-0cfad2b6638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa132be0-cea8-4296-88f2-0cfad2b6638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1323641545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade35d16-97a2-4e1e-ba37-ee369295a631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:40Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:40 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:40 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226b0e63-79fd-4ca7-ba71-8ad7c0e85b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226b0e63-79fd-4ca7-ba71-8ad7c0e85b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fd0a3f-82e6-4a31-9982-e9ef08c802be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fd0a3f-82e6-4a31-9982-e9ef08c802be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade35d16-97a2-4e1e-ba37-ee369295a631', 'volume_name': 'volume-ade35d16-97a2-4e1e-ba37-ee369295a631', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e59c28-803e-49a7-8ed0-ec2b5403604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e59c28-803e-49a7-8ed0-ec2b5403604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcba155-1487-4038-a4b6-b3773aaa6d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Volume ade35d16-97a2-4e1e-ba37-ee369295a631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade35d16-97a2-4e1e-ba37-ee369295a631', 'volume_size': 1} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:40 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b Sep 25 17:15:40 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:40 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.312s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Deleted volume successfully. Sep 25 17:15:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dc77d304-c5c0-4b32-90da-d17e6b5294a8 tempest-VolumesGetTest-1790645599 None] Lock "cinder-a7a8be0e-d530-414e-91f7-b16778c93d77-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:41 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1323641545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade35d16-97a2-4e1e-ba37-ee369295a631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6987d55382b24c8da43a19aea4222452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:40Z,use_quota=True,user_id='89beab2eec5141e68c3cf398adc21c29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Creating volume ade35d16-97a2-4e1e-ba37-ee369295a631 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:41 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab70dbb5-553e-4847-a64f-bf32b5fe36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8dd603-93a4-45fc-af2a-4495864ba451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:41 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631 1073741824 Sep 25 17:15:41 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b (96def317-fdac-4dbb-bf4e-0e7eee812c9b): created successfully Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8dd603-93a4-45fc-af2a-4495864ba451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (0368d927-2d9c-41ca-b158-36c7b5e97029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-49fe6534-5233-4310-bae9-9699a0d530a6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created volume successfully. Sep 25 17:15:41 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631 1073741824" returned: 0 in 0.684s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:42 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631 Sep 25 17:15:42 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:42 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcba155-1487-4038-a4b6-b3773aaa6d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade35d16-97a2-4e1e-ba37-ee369295a631', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc74555-83a5-4536-848b-58ba6c9dd3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Volume volume-ade35d16-97a2-4e1e-ba37-ee369295a631 (ade35d16-97a2-4e1e-ba37-ee369295a631): created successfully Sep 25 17:15:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc74555-83a5-4536-848b-58ba6c9dd3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Flow 'volume_create_manager' (b697097e-8d13-48cd-8f31-1aef6e2cc1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0bda0acb-bee8-470e-93fa-d96747a12682 tempest-VolumesActionsTest-122577051 None] Created volume successfully. Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (e51f2d6f-81f3-48fe-af68-4f5d60db89bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90a712b-bc14-4a9b-a2b0-abd6e1bad822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (7680cac8-caff-426b-a660-88cab4f0a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c569714d-bf07-4cb0-9ade-553016e12e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90a712b-bc14-4a9b-a2b0-abd6e1bad822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737476226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea439a5-6d1a-457e-abd8-ab6ff5b289eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:43Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7085e2-356f-4ac2-be10-8ec42f6e73cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7085e2-356f-4ac2-be10-8ec42f6e73cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7396257-6746-46a7-9956-c3f5095b0f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7396257-6746-46a7-9956-c3f5095b0f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea439a5-6d1a-457e-abd8-ab6ff5b289eb', 'volume_name': 'volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898873f1-fc66-416a-a7f4-ad4efbbecbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898873f1-fc66-416a-a7f4-ad4efbbecbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c00374-9ae8-4194-8892-4129c15b38d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume bea439a5-6d1a-457e-abd8-ab6ff5b289eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb', 'volume_size': 1} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-737476226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea439a5-6d1a-457e-abd8-ab6ff5b289eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:43Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Creating volume bea439a5-6d1a-457e-abd8-ab6ff5b289eb {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:43 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:43 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb 1073741824 Sep 25 17:15:43 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c569714d-bf07-4cb0-9ade-553016e12e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1158985758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f51dde-25c8-4b22-9418-37e45c82148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:43Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71669469-9963-4b2a-a4b3-c2857f30ed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71669469-9963-4b2a-a4b3-c2857f30ed41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695473a6-d9c6-4c74-acd9-e19cf98c99ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695473a6-d9c6-4c74-acd9-e19cf98c99ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f51dde-25c8-4b22-9418-37e45c82148a', 'volume_name': 'volume-d0f51dde-25c8-4b22-9418-37e45c82148a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8354f702-0a9a-4955-891a-205cbfe5fb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8354f702-0a9a-4955-891a-205cbfe5fb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3856d7ee-d36a-49a0-9730-da45bd9c5da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Volume d0f51dde-25c8-4b22-9418-37e45c82148a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f51dde-25c8-4b22-9418-37e45c82148a', 'volume_size': 1} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (a0fb3f19-0e9a-45fd-adfe-75ec17934473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24f0ba7-bd08-488b-b447-303292ad2ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24f0ba7-bd08-488b-b447-303292ad2ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825272903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285fc837-2640-4fa5-9493-9b1f154d764d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:43Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9771924e-c525-485a-9e45-b574935c2ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9771924e-c525-485a-9e45-b574935c2ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a48fd1-319f-46e3-b850-02ea46089b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a48fd1-319f-46e3-b850-02ea46089b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '285fc837-2640-4fa5-9493-9b1f154d764d', 'volume_name': 'volume-285fc837-2640-4fa5-9493-9b1f154d764d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987feb37-47bc-488c-9793-64120c9dad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987feb37-47bc-488c-9793-64120c9dad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7df6e0-0296-4d97-990e-280ebf609ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume 285fc837-2640-4fa5-9493-9b1f154d764d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-285fc837-2640-4fa5-9493-9b1f154d764d', 'volume_size': 1} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (86cb36fa-d6d9-4317-95f3-8c22f4db7839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a0599b-1aad-4a15-94d5-856ba61a5184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a0599b-1aad-4a15-94d5-856ba61a5184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11154301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e83524-cdde-4dda-8091-fb447eaef748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:44Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fe4668-601b-4c6f-9103-7fd8f618da01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fe4668-601b-4c6f-9103-7fd8f618da01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e29d3a3-0c95-4f58-ad7f-fbd8c3a569aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e29d3a3-0c95-4f58-ad7f-fbd8c3a569aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e83524-cdde-4dda-8091-fb447eaef748', 'volume_name': 'volume-25e83524-cdde-4dda-8091-fb447eaef748', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481150b4-760a-4ff6-b1c8-1a0310518429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481150b4-760a-4ff6-b1c8-1a0310518429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2648c30-d45b-4dfe-a8cc-ffd1d2435e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume 25e83524-cdde-4dda-8091-fb447eaef748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e83524-cdde-4dda-8091-fb447eaef748', 'volume_size': 1} Sep 25 17:15:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:44 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb 1073741824" returned: 0 in 0.877s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:44 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb Sep 25 17:15:44 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (829e459e-961c-4275-a2a0-098224a06e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8a8d3c-2439-4873-bce2-5f9fb78bcf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8a8d3c-2439-4873-bce2-5f9fb78bcf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825645620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10448a21-5856-4445-9f63-360746bc6168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:44Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b9ead-64d7-444e-8cd3-d80c5eab2f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b9ead-64d7-444e-8cd3-d80c5eab2f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8c628b-07ab-4c74-803b-94ae1f031838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8c628b-07ab-4c74-803b-94ae1f031838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10448a21-5856-4445-9f63-360746bc6168', 'volume_name': 'volume-10448a21-5856-4445-9f63-360746bc6168', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20163a6f-71a4-47d3-ad6e-ce4504e501bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20163a6f-71a4-47d3-ad6e-ce4504e501bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6592faeb-7a82-4479-a82c-79cda3c63124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:44 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume 10448a21-5856-4445-9f63-360746bc6168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10448a21-5856-4445-9f63-360746bc6168', 'volume_size': 1} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:44 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb" returned: 0 in 0.464s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1158985758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f51dde-25c8-4b22-9418-37e45c82148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:43Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Creating volume d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:44 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c00374-9ae8-4194-8892-4129c15b38d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca78dcd-620a-40dc-9eed-fd45fc10e400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:44 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a 1073741824 Sep 25 17:15:44 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:44 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb (bea439a5-6d1a-457e-abd8-ab6ff5b289eb): created successfully Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca78dcd-620a-40dc-9eed-fd45fc10e400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (e51f2d6f-81f3-48fe-af68-4f5d60db89bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3ffe89b9-0f12-46f5-b0ec-b3d7837537b6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created volume successfully. Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Acquiring lock "cinder-ade35d16-97a2-4e1e-ba37-ee369295a631-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Lock "cinder-ade35d16-97a2-4e1e-ba37-ee369295a631-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (0f44716f-a0ae-46d3-892c-e6f977628b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1247642-6c46-40e2-9ddc-3505ae49c6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1247642-6c46-40e2-9ddc-3505ae49c6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1101362434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03be07f4-f156-4f7b-bb2e-1e30db2fbda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:45Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80619f15-53a6-4b5b-9309-82604b89c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80619f15-53a6-4b5b-9309-82604b89c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660d1942-a1db-47e0-86b7-eaf7cdd22a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660d1942-a1db-47e0-86b7-eaf7cdd22a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03be07f4-f156-4f7b-bb2e-1e30db2fbda6', 'volume_name': 'volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd4f7e1-b927-4be8-87ba-1f1ae60fc905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd4f7e1-b927-4be8-87ba-1f1ae60fc905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d3c5c9-128a-412d-813e-2e292687f1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume 03be07f4-f156-4f7b-bb2e-1e30db2fbda6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6', 'volume_size': 1} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Acquiring lock "cinder-quobyte-ade35d16-97a2-4e1e-ba37-ee369295a631" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Lock "cinder-quobyte-ade35d16-97a2-4e1e-ba37-ee369295a631" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aec2dbb-5c7c-4015-95e5-3d60389940ef]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:45 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631 Sep 25 17:15:45 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:45 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a 1073741824" returned: 0 in 0.807s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:45 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a Sep 25 17:15:45 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:45 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:45 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631 Sep 25 17:15:45 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:45 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.460s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825272903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285fc837-2640-4fa5-9493-9b1f154d764d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:43Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Creating volume 285fc837-2640-4fa5-9493-9b1f154d764d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:45 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3856d7ee-d36a-49a0-9730-da45bd9c5da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f51dde-25c8-4b22-9418-37e45c82148a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b079622-c949-40e4-b6ad-4939b86046cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:45 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d 1073741824 Sep 25 17:15:45 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Volume volume-d0f51dde-25c8-4b22-9418-37e45c82148a (d0f51dde-25c8-4b22-9418-37e45c82148a): created successfully Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b079622-c949-40e4-b6ad-4939b86046cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (7680cac8-caff-426b-a660-88cab4f0a78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-16aa8d71-4ace-4536-8d86-aa3a9ab74c7b tempest-VolumesGetTest-1790645599 None] Created volume successfully. Sep 25 17:15:46 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ade35d16-97a2-4e1e-ba37-ee369295a631" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Lock "cinder-quobyte-ade35d16-97a2-4e1e-ba37-ee369295a631" released by "delete_volume" :: held 0.931s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Created reservations ['103b119c-fe18-4255-bd7f-ced28d525365', '4e8fd3dc-105a-406e-bb69-7f53f706cc2f', '023018ec-0f69-4f38-9c8c-e5381a612701', '7fb21b14-3b7a-487f-b023-d81f7d043813'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:46 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:46 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:46 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d 1073741824" returned: 0 in 0.731s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:46 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.334s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Deleted volume successfully. Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6c3145c6-1a54-48c3-889a-7d19eea0bb5a tempest-VolumesActionsTest-122577051 None] Lock "cinder-ade35d16-97a2-4e1e-ba37-ee369295a631-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:46 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d Sep 25 17:15:46 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:47 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d" returned: 0 in 0.403s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.250s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-11154301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e83524-cdde-4dda-8091-fb447eaef748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:44Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Creating volume 25e83524-cdde-4dda-8091-fb447eaef748 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:47 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7df6e0-0296-4d97-990e-280ebf609ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-285fc837-2640-4fa5-9493-9b1f154d764d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89de8f69-2b82-486f-9bf2-06986c337f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:47 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748 1073741824 Sep 25 17:15:47 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume volume-285fc837-2640-4fa5-9493-9b1f154d764d (285fc837-2640-4fa5-9493-9b1f154d764d): created successfully Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89de8f69-2b82-486f-9bf2-06986c337f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (a0fb3f19-0e9a-45fd-adfe-75ec17934473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b0e246c0-37c7-4ce1-a980-99474b6bdfd2 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created volume successfully. Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (8aa83c44-9ffe-4bfa-a061-e3da15354f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c9f05c-121c-4e7d-8e42-a63d9da7d417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c9f05c-121c-4e7d-8e42-a63d9da7d417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1614179544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca06b0d-1cda-4675-a12d-acf776318c0a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d0f51dde-25c8-4b22-9418-37e45c82148a,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:48Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818d35c4-6120-4edc-a95c-adec4c20f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818d35c4-6120-4edc-a95c-adec4c20f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30edf247-2643-4d6a-9251-6cc8cf9ce5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30edf247-2643-4d6a-9251-6cc8cf9ce5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fca06b0d-1cda-4675-a12d-acf776318c0a', 'volume_name': 'volume-fca06b0d-1cda-4675-a12d-acf776318c0a', 'volume_size': 1, 'source_volid': 'd0f51dde-25c8-4b22-9418-37e45c82148a', 'source_volstatus': 'available'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b136ac9-1e44-4785-8d3e-c9d6990dc7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b136ac9-1e44-4785-8d3e-c9d6990dc7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dc090a-f885-4a65-b2c0-527f24a91750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Volume fca06b0d-1cda-4675-a12d-acf776318c0a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fca06b0d-1cda-4675-a12d-acf776318c0a', 'volume_size': 1, 'source_volid': 'd0f51dde-25c8-4b22-9418-37e45c82148a', 'source_volstatus': 'available'} Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:47 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748 1073741824" returned: 0 in 0.847s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:48 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748 Sep 25 17:15:48 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:48 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.929s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825645620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10448a21-5856-4445-9f63-360746bc6168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:44Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Creating volume 10448a21-5856-4445-9f63-360746bc6168 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:48 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2648c30-d45b-4dfe-a8cc-ffd1d2435e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e83524-cdde-4dda-8091-fb447eaef748', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:48 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168 1073741824 Sep 25 17:15:48 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad17473-1f7c-46c3-83b1-f95cd4027767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:48 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume volume-25e83524-cdde-4dda-8091-fb447eaef748 (25e83524-cdde-4dda-8091-fb447eaef748): created successfully Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad17473-1f7c-46c3-83b1-f95cd4027767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (86cb36fa-d6d9-4317-95f3-8c22f4db7839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f9fd0a12-954f-4208-b13b-ea9d3c703268 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created volume successfully. Sep 25 17:15:48 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168 1073741824" returned: 0 in 0.617s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:49 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168 Sep 25 17:15:49 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:49 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168" returned: 0 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.166s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1101362434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03be07f4-f156-4f7b-bb2e-1e30db2fbda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed0184649c047a7894eb58aaaf1c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:15:45Z,use_quota=True,user_id='d3eeb4ef4ded4d2dafdbdc835313694f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Creating volume 03be07f4-f156-4f7b-bb2e-1e30db2fbda6 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:15:49 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6592faeb-7a82-4479-a82c-79cda3c63124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10448a21-5856-4445-9f63-360746bc6168', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf5c200-c728-46e8-8809-91055d3e281a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:49 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 1073741824 Sep 25 17:15:49 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume volume-10448a21-5856-4445-9f63-360746bc6168 (10448a21-5856-4445-9f63-360746bc6168): created successfully Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf5c200-c728-46e8-8809-91055d3e281a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (829e459e-961c-4275-a2a0-098224a06e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0b503856-e11d-49c3-bab3-bacad0391c85 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created volume successfully. Sep 25 17:15:50 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 1073741824" returned: 0 in 0.704s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:50 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 Sep 25 17:15:50 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:50 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.657s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:50 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Cloning volume d0f51dde-25c8-4b22-9418-37e45c82148a to volume fca06b0d-1cda-4675-a12d-acf776318c0a Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d3c5c9-128a-412d-813e-2e292687f1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08ef428-b1a9-454f-9109-2ec508b55955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:15:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Volume volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 (03be07f4-f156-4f7b-bb2e-1e30db2fbda6): created successfully Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08ef428-b1a9-454f-9109-2ec508b55955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Flow 'volume_create_manager' (0f44716f-a0ae-46d3-892c-e6f977628b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Creating offline snapshot f1afed05-bcfb-445b-8adc-4de7fcf0c37d of volume d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:15:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-684b1198-b7b3-44fe-a50d-cd258f10c83a tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created volume successfully. Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f5ea9-4dfb-4489-83c2-285d8e4841df]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:50 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a Sep 25 17:15:50 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:51 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:51 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d 1G Sep 25 17:15:51 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-03be07f4-f156-4f7b-bb2e-1e30db2fbda6-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-03be07f4-f156-4f7b-bb2e-1e30db2fbda6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:51 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d 1G" returned: 0 in 0.642s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f51dde-25c8-4b22-9418-37e45c82148a -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-quobyte-03be07f4-f156-4f7b-bb2e-1e30db2fbda6" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:51 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f51dde-25c8-4b22-9418-37e45c82148a -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d Sep 25 17:15:51 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-03be07f4-f156-4f7b-bb2e-1e30db2fbda6" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e170ce8-fff4-4261-843b-b7e4cb81fc35]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:52 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 Sep 25 17:15:52 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:52 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f51dde-25c8-4b22-9418-37e45c82148a -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d" returned: 0 in 0.496s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:52 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d is being set with open permissions: ugo+rw Sep 25 17:15:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:52 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d Sep 25 17:15:52 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:52 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6" returned: 0 in 0.568s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:52 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6 Sep 25 17:15:52 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:52 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d" returned: 0 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:52 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.info Sep 25 17:15:52 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:52 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-03be07f4-f156-4f7b-bb2e-1e30db2fbda6" returned: 0 in 0.403s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-03be07f4-f156-4f7b-bb2e-1e30db2fbda6" released by "delete_volume" :: held 1.064s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created reservations ['bc537052-6477-432d-b695-e9a5ae5a5323', '00f5fb31-90cb-4540-a3e2-36dd336089a7', 'cd99c743-86dd-4bb1-a4a1-1ab2266791d8', 'a8c98d07-5a89-4a40-8edf-57d4a36ef1b7'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:53 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:53 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:53 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.info" returned: 0 in 0.573s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:53 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.info is being set with open permissions: ugo+rw Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:53 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.info Sep 25 17:15:53 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:53 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:53 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.info" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-quobyte-fca06b0d-1cda-4675-a12d-acf776318c0a" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.399s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Deleted volume successfully. Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-fca06b0d-1cda-4675-a12d-acf776318c0a" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] snapshot: f1afed05-bcfb-445b-8adc-4de7fcf0c37d, volume: fca06b0d-1cda-4675-a12d-acf776318c0a, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f380294-bacc-4ed3-8cf3-820f80ef81fc]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-718add6f-3d1e-4419-aa3a-404b5029eec8 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-03be07f4-f156-4f7b-bb2e-1e30db2fbda6-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:53 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d Sep 25 17:15:53 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-10448a21-5856-4445-9f63-360746bc6168-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-10448a21-5856-4445-9f63-360746bc6168-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-quobyte-10448a21-5856-4445-9f63-360746bc6168" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-10448a21-5856-4445-9f63-360746bc6168" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fc7daa-11c1-42bb-90be-0a8a8208c9c5]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:54 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d" returned: 0 in 0.607s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f51dde-25c8-4b22-9418-37e45c82148a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1532da-8881-4c31-8964-b288a56dc0d6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:54 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a Sep 25 17:15:54 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:54 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168 Sep 25 17:15:54 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:54 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:54 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a" returned: 0 in 0.431s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:15:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:54 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168 Sep 25 17:15:54 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:54 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a Sep 25 17:15:54 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:55 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-10448a21-5856-4445-9f63-360746bc6168" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-10448a21-5856-4445-9f63-360746bc6168" released by "delete_volume" :: held 0.848s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created reservations ['19fe024d-762a-48e1-b131-19db039d8f46', '0934b258-bf47-4b81-a8ba-a5c9addfd722', 'dd92152d-9892-4d64-972b-8d381453cd85', '1025d439-e062-4923-b54c-863212417be3'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:55 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:55 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-25e83524-cdde-4dda-8091-fb447eaef748-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-25e83524-cdde-4dda-8091-fb447eaef748-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-quobyte-25e83524-cdde-4dda-8091-fb447eaef748" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-25e83524-cdde-4dda-8091-fb447eaef748" acquired by "delete_volume" :: waited 0.055s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3806af-e8d4-49aa-bb8a-b3fe4c8250f5]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:56 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.747s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Deleted volume successfully. Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:56 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748 Sep 25 17:15:56 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:56 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c98e506-37ab-4a9b-a4a0-fc95631a5cd6 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-10448a21-5856-4445-9f63-360746bc6168-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:56 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:56 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.740s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:15:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:15:57 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748" returned: 0 in 1.038s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:57 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748 Sep 25 17:15:57 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:57 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-25e83524-cdde-4dda-8091-fb447eaef748" returned: 0 in 0.437s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-25e83524-cdde-4dda-8091-fb447eaef748" released by "delete_volume" :: held 1.599s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created reservations ['9f1ac7b8-6dd1-4190-bb45-66c2441d3955', '74f95aa3-4748-455e-843e-ecca522d60b2', '5d327339-38b6-48e1-a54c-504d1a6f1be2', '0f156f81-38f3-4bf0-a050-be5d37daf87d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:15:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-285fc837-2640-4fa5-9493-9b1f154d764d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:58 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:15:58 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-285fc837-2640-4fa5-9493-9b1f154d764d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-quobyte-285fc837-2640-4fa5-9493-9b1f154d764d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:15:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-285fc837-2640-4fa5-9493-9b1f154d764d" acquired by "delete_volume" :: waited 0.050s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:15:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1205c1-53b5-49d9-aee2-6de7987c9e84]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:15:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:58 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d Sep 25 17:15:58 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:15:58 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.905s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:58 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:15:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Deleted volume successfully. Sep 25 17:15:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bacaec67-2485-440f-85eb-25202a53bbd7 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-25e83524-cdde-4dda-8091-fb447eaef748-delete_volume" released by "delete_volume" :: held 3.494s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:15:59 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Sep 25 17:15:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d" returned: 0 in 1.307s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:15:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:15:59 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d Sep 25 17:15:59 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:00 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-285fc837-2640-4fa5-9493-9b1f154d764d" returned: 0 in 0.532s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-285fc837-2640-4fa5-9493-9b1f154d764d" released by "delete_volume" :: held 1.965s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:00 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created reservations ['c2b04769-97c0-495b-98af-42ae8e666bf2', 'e20a5fb9-01f7-48b0-9ace-f984b0d81712', '201bbf57-277e-4f8b-abb6-05e3acbc8c40', '2cff02b4-78c2-49c7-bf6b-662a55297894'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:00 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:00 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:01 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.742s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:01 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Deleted volume successfully. Sep 25 17:16:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4bbb9739-6e78-4b62-8d3f-567b97955da3 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-285fc837-2640-4fa5-9493-9b1f154d764d-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-bea439a5-6d1a-457e-abd8-ab6ff5b289eb-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-bea439a5-6d1a-457e-abd8-ab6ff5b289eb-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-quobyte-bea439a5-6d1a-457e-abd8-ab6ff5b289eb" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-bea439a5-6d1a-457e-abd8-ab6ff5b289eb" acquired by "delete_volume" :: waited 0.071s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae01cd76-ddec-46c7-89b9-4c958ebe08b3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:02 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb Sep 25 17:16:02 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:03 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb" returned: 0 in 1.448s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:03 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb Sep 25 17:16:03 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:04 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bea439a5-6d1a-457e-abd8-ab6ff5b289eb" returned: 0 in 0.724s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-bea439a5-6d1a-457e-abd8-ab6ff5b289eb" released by "delete_volume" :: held 2.345s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created reservations ['ee655fd2-b535-4ded-99f3-7a8c049e4542', '99f6137a-991c-423f-86b7-505d2ff8d5c4', 'a94db615-1c98-4cb4-a27c-5b7332f2a7fd', '79e9cc12-6f41-4a62-81fa-807ed679406b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:04 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:04 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:05 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a" returned: 0 in 10.266s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a, size 1024.00 MB, duration 10.27 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:16:05 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Converted 1024.00 MB image at 99.73 MB/s Sep 25 17:16:05 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a is being set with open permissions: ugo+rw Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:05 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a Sep 25 17:16:05 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:05 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.363s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Deleted volume successfully. Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c3c3f5e1-ef7c-4756-804c-dc887b592964 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-bea439a5-6d1a-457e-abd8-ab6ff5b289eb-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:05 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a" returned: 0 in 0.417s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-fca06b0d-1cda-4675-a12d-acf776318c0a" released by "_copy_volume_from_snapshot" :: held 11.830s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-quobyte-f1afed05-bcfb-445b-8adc-4de7fcf0c37d" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-96def317-fdac-4dbb-bf4e-0e7eee812c9b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-f1afed05-bcfb-445b-8adc-4de7fcf0c37d" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Deleting offline snapshot f1afed05-bcfb-445b-8adc-4de7fcf0c37d of volume d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] snapshot_file for this snap is: volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-96def317-fdac-4dbb-bf4e-0e7eee812c9b-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[db724f47-e402-48c3-b790-bec657a6f364]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "cinder-quobyte-96def317-fdac-4dbb-bf4e-0e7eee812c9b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-96def317-fdac-4dbb-bf4e-0e7eee812c9b" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[02024104-5fd3-4880-9162-81b91f7cfbe3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:05 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d Sep 25 17:16:05 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:06 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b Sep 25 17:16:06 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:06 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d" returned: 0 in 0.628s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f51dde-25c8-4b22-9418-37e45c82148a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:16:06 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b" returned: 0 in 0.542s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ba8868-c5d3-4ee8-872a-07d26d2dbbfd]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:06 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b Sep 25 17:16:06 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:06 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a Sep 25 17:16:06 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:06 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-96def317-fdac-4dbb-bf4e-0e7eee812c9b" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-quobyte-96def317-fdac-4dbb-bf4e-0e7eee812c9b" released by "delete_volume" :: held 1.007s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Created reservations ['2facb8f3-f9bd-4d07-9a1b-cc827a550288', 'c757fd38-26dc-4166-8c25-dbe75a93253f', '5b7d00d1-bee4-4843-84c1-51081df200b6', 'e9487a92-0031-4ed6-aaae-3a6e63ed5c60'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:07 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:07 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:07 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a" returned: 0 in 0.764s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:07 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d Sep 25 17:16:07 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:07 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:07 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Deleted volume successfully. Sep 25 17:16:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e2054360-e236-4183-931f-add630f86bf0 tempest-CreateVolumesFromSourceVolumeTest-1986571451 None] Lock "cinder-96def317-fdac-4dbb-bf4e-0e7eee812c9b-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:07 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d" returned: 0 in 0.484s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:07 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d Sep 25 17:16:07 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:08 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a.f1afed05-bcfb-445b-8adc-4de7fcf0c37d" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-f1afed05-bcfb-445b-8adc-4de7fcf0c37d" released by "_delete_snapshot" :: held 2.554s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.704s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dc090a-f885-4a65-b2c0-527f24a91750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca06b0d-1cda-4675-a12d-acf776318c0a', 'volume_size': 1, 'source_volid': 'd0f51dde-25c8-4b22-9418-37e45c82148a', 'source_volstatus': 'available'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb06c9a-49a1-46a7-98ea-45049b1d4be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Volume volume-fca06b0d-1cda-4675-a12d-acf776318c0a (fca06b0d-1cda-4675-a12d-acf776318c0a): created successfully Sep 25 17:16:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb06c9a-49a1-46a7-98ea-45049b1d4be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (8aa83c44-9ffe-4bfa-a061-e3da15354f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3466779b-0770-400c-9c2b-f52f63c78396 tempest-VolumesGetTest-1790645599 None] Created volume successfully. Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (dce4a86f-67e0-41bf-9392-8b3369d10bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa64035-6092-40d6-aae2-80c0bdad0dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa64035-6092-40d6-aae2-80c0bdad0dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1864996853',display_name='tempest-VolumesGetTest-Volume-778378244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f0fa0b-9294-470a-b248-820da775a715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:11Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898cafa2-05a4-483c-b8f5-2fb6033febea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898cafa2-05a4-483c-b8f5-2fb6033febea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7042a094-2597-45b5-ab20-566ef4ea1cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7042a094-2597-45b5-ab20-566ef4ea1cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f0fa0b-9294-470a-b248-820da775a715', 'volume_name': 'volume-54f0fa0b-9294-470a-b248-820da775a715', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb371e23-c62d-4d7d-99ac-9d5a149d4385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb371e23-c62d-4d7d-99ac-9d5a149d4385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12dbec3-5d33-45ef-93ed-405f49ac1aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Volume 54f0fa0b-9294-470a-b248-820da775a715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f0fa0b-9294-470a-b248-820da775a715', 'volume_size': 1} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1864996853',display_name='tempest-VolumesGetTest-Volume-778378244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f0fa0b-9294-470a-b248-820da775a715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:11Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Creating volume 54f0fa0b-9294-470a-b248-820da775a715 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:10 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:10 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715 1073741824 Sep 25 17:16:10 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:11 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715 1073741824" returned: 0 in 0.868s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:11 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715 Sep 25 17:16:11 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:12 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12dbec3-5d33-45ef-93ed-405f49ac1aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f0fa0b-9294-470a-b248-820da775a715', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed74af3-0ae0-48c4-9ee4-bc9435f34eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Volume volume-54f0fa0b-9294-470a-b248-820da775a715 (54f0fa0b-9294-470a-b248-820da775a715): created successfully Sep 25 17:16:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed74af3-0ae0-48c4-9ee4-bc9435f34eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (dce4a86f-67e0-41bf-9392-8b3369d10bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1549b4db-5eec-4a4d-96c2-c9328597279e tempest-VolumesGetTest-1790645599 None] Created volume successfully. Sep 25 17:16:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-54f0fa0b-9294-470a-b248-820da775a715-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Lock "cinder-54f0fa0b-9294-470a-b248-820da775a715-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-quobyte-54f0fa0b-9294-470a-b248-820da775a715" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-54f0fa0b-9294-470a-b248-820da775a715" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[182804f1-7465-46de-b6f9-18f61a00d654]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:13 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715 Sep 25 17:16:13 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:13 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715" returned: 0 in 0.536s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:13 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715 Sep 25 17:16:13 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:14 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54f0fa0b-9294-470a-b248-820da775a715" returned: 0 in 0.412s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-54f0fa0b-9294-470a-b248-820da775a715" released by "delete_volume" :: held 1.056s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Created reservations ['52ad9b1f-3867-45d1-b64e-86a346d53b56', '4a67bd79-03f7-4271-9396-66a54cdc519c', 'c3f9866c-45b8-4fb8-9d93-d51b8fd82440', 'c9b19048-1c30-411b-b487-564ed3c44c73'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:14 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:14 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:14 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Deleted volume successfully. Sep 25 17:16:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-635c7fb1-34ad-4e03-ae4e-95b83e1510ac tempest-VolumesGetTest-1790645599 None] Lock "cinder-54f0fa0b-9294-470a-b248-820da775a715-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Flow 'volume_create_manager' (8874f6a9-15c5-4f91-b03c-f3058df60b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e013df12-2116-4201-bd5e-48c5d0a401c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e013df12-2116-4201-bd5e-48c5d0a401c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-57537637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ad031d-82bf-4d7c-b455-17494d26138e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76198a77a63e4eedb4c790a0273ad49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:15Z,use_quota=True,user_id='97d6c9ced15444859126945b6ee4e47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fffbf46-90dd-4759-8f27-70c7028de1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fffbf46-90dd-4759-8f27-70c7028de1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c09b76f-06a8-427e-af6a-54116782d6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c09b76f-06a8-427e-af6a-54116782d6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ad031d-82bf-4d7c-b455-17494d26138e', 'volume_name': 'volume-e9ad031d-82bf-4d7c-b455-17494d26138e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e88f666-09a8-45f6-b8c9-129a6ab0626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e88f666-09a8-45f6-b8c9-129a6ab0626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd43e730-0fe1-44c5-81ff-34b3bd103895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Volume e9ad031d-82bf-4d7c-b455-17494d26138e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ad031d-82bf-4d7c-b455-17494d26138e', 'volume_size': 1} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-57537637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ad031d-82bf-4d7c-b455-17494d26138e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76198a77a63e4eedb4c790a0273ad49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:15Z,use_quota=True,user_id='97d6c9ced15444859126945b6ee4e47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Creating volume e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:15 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-fca06b0d-1cda-4675-a12d-acf776318c0a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Lock "cinder-fca06b0d-1cda-4675-a12d-acf776318c0a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:15 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e 1073741824 Sep 25 17:16:15 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-quobyte-fca06b0d-1cda-4675-a12d-acf776318c0a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-fca06b0d-1cda-4675-a12d-acf776318c0a" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5927e666-9507-41ba-8341-30995f6d4cf9]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:15 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a Sep 25 17:16:15 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:16 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e 1073741824" returned: 0 in 0.746s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:16 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a" returned: 0 in 0.537s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:16 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a Sep 25 17:16:16 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:16 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e Sep 25 17:16:16 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:16 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-fca06b0d-1cda-4675-a12d-acf776318c0a" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-fca06b0d-1cda-4675-a12d-acf776318c0a" released by "delete_volume" :: held 0.952s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:16 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd43e730-0fe1-44c5-81ff-34b3bd103895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ad031d-82bf-4d7c-b455-17494d26138e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a67219-212b-4290-8d3d-67a0686b337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Created reservations ['7facf198-aad8-4a06-8cd0-59de893740ac', '28a4c218-4c74-4ecc-aae8-7676603fb32b', 'e72dcc91-1d3e-4005-92c0-6b0e8f5bd288', '0b872d86-22ae-4107-9424-0546c46c969b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Volume volume-e9ad031d-82bf-4d7c-b455-17494d26138e (e9ad031d-82bf-4d7c-b455-17494d26138e): created successfully Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a67219-212b-4290-8d3d-67a0686b337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Flow 'volume_create_manager' (8874f6a9-15c5-4f91-b03c-f3058df60b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b0d755a4-c83b-4030-9c23-d13e5726644c tempest-VolumeDependencyTests-1395054317 None] Created volume successfully. Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:17 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:17 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Flow 'volume_create_manager' (3730be92-1617-44bb-8616-85ce7dbd3f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d35ba7-9a32-4a6e-8202-1a58267f8596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d35ba7-9a32-4a6e-8202-1a58267f8596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-175634953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584dfe69-6942-4759-81cc-a6aa2bb45201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90cdd3638074a5a8a3ac7e16c7c0667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:17Z,use_quota=True,user_id='adae382da2e342c6866df77f250652f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7070c4ab-532b-405d-a34a-f04784692f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7070c4ab-532b-405d-a34a-f04784692f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b241e879-1798-462e-94bc-8ac62e75a733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:16:17 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.314s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Deleted volume successfully. Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-967ae2a9-54ae-425f-b18b-e762e3cb24c0 tempest-VolumesGetTest-1790645599 None] Lock "cinder-fca06b0d-1cda-4675-a12d-acf776318c0a-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Creating offline snapshot d1d3ae7c-b792-40de-b960-33d8eb9e8346 of volume e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c2632c-c430-4d69-9b3d-d7e3d2c6e2b2]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:17 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e Sep 25 17:16:17 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b241e879-1798-462e-94bc-8ac62e75a733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '584dfe69-6942-4759-81cc-a6aa2bb45201', 'volume_name': 'volume-584dfe69-6942-4759-81cc-a6aa2bb45201', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0389c7-7ee0-422b-b1fa-85a661f4e09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0389c7-7ee0-422b-b1fa-85a661f4e09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e290df-558b-4969-9a20-59dee85a43f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Volume 584dfe69-6942-4759-81cc-a6aa2bb45201: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-584dfe69-6942-4759-81cc-a6aa2bb45201', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:16:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Trying to clone 584dfe69-6942-4759-81cc-a6aa2bb45201 from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-d0f51dde-25c8-4b22-9418-37e45c82148a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Lock "cinder-d0f51dde-25c8-4b22-9418-37e45c82148a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:18 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e" returned: 0 in 0.555s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:18 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 1G Sep 25 17:16:18 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-quobyte-d0f51dde-25c8-4b22-9418-37e45c82148a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-d0f51dde-25c8-4b22-9418-37e45c82148a" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d14a9e-b983-4aff-9313-93fe7ee6af27]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:16:18 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Image download 20.69 MB at 20.69 MB/s Sep 25 17:16:18 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a Sep 25 17:16:18 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ffc08e-4f27-4a79-90c9-e224e0ea3904]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:18 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD Sep 25 17:16:18 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:18 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 1G" returned: 0 in 0.647s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9ad031d-82bf-4d7c-b455-17494d26138e -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:18 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9ad031d-82bf-4d7c-b455-17494d26138e -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 Sep 25 17:16:18 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:18 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a" returned: 0 in 0.520s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:18 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a Sep 25 17:16:18 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:18 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:18 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 is fetched for user adae382da2e342c6866df77f250652f7. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dd2687-6fc3-413b-b1ea-fd7786573bb1]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:19 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d0f51dde-25c8-4b22-9418-37e45c82148a" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:19 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD Sep 25 17:16:19 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-d0f51dde-25c8-4b22-9418-37e45c82148a" released by "delete_volume" :: held 1.047s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:19 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9ad031d-82bf-4d7c-b455-17494d26138e -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346" returned: 0 in 0.509s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 is being set with open permissions: ugo+rw Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:19 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 Sep 25 17:16:19 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Created reservations ['294efc05-78b7-4317-bbe8-e4b806a68258', '6b6a0db3-e2c2-4e74-b208-047c51be0f1e', '6e424aa6-af43-4c14-b815-cc98f6b9938a', 'a87058df-8d98-4419-bfc6-2fca0b94811e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:19 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:19 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:19 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD" returned: 0 in 0.516s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:19 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346" returned: 0 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:19 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.info Sep 25 17:16:19 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:19 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.335s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Deleted volume successfully. Sep 25 17:16:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796d39b6-3e4a-427a-982b-c112cbb20cb6 tempest-VolumesGetTest-1790645599 None] Lock "cinder-d0f51dde-25c8-4b22-9418-37e45c82148a-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:20 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.info" returned: 0 in 0.294s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:20 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.info is being set with open permissions: ugo+rw Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:20 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.info Sep 25 17:16:20 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:20 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.info" returned: 0 in 0.275s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-175634953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584dfe69-6942-4759-81cc-a6aa2bb45201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90cdd3638074a5a8a3ac7e16c7c0667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:17Z,use_quota=True,user_id='adae382da2e342c6866df77f250652f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Creating volume 584dfe69-6942-4759-81cc-a6aa2bb45201 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:20 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:20 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 1073741824 Sep 25 17:16:20 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c9621fa7-c2fe-43f1-bf70-6e05fa547028 tempest-VolumeDependencyTests-1395054317 None] Create snapshot completed successfully Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Flow 'volume_create_manager' (4509d614-25c4-48b7-8bbb-d7658d6b20a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0e966f-cb74-4cc3-b977-ad1b876a59a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0e966f-cb74-4cc3-b977-ad1b876a59a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1384165374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6106697f-844f-4ddb-824a-d5877f392f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5394abd11d4a0ba4f9efa0b5259b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:21Z,use_quota=True,user_id='abebcd8e5b6149198a16c91dcf4c250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30465df-d27e-4449-bb45-519d68beef3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30465df-d27e-4449-bb45-519d68beef3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d192de-0730-4b82-9d2e-64947af489b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d192de-0730-4b82-9d2e-64947af489b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6106697f-844f-4ddb-824a-d5877f392f2d', 'volume_name': 'volume-6106697f-844f-4ddb-824a-d5877f392f2d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d340c9b7-fb60-4293-913b-93ac1954abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d340c9b7-fb60-4293-913b-93ac1954abca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf9ff50-8c35-4a51-a5de-83e7d0de5094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:20 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Volume 6106697f-844f-4ddb-824a-d5877f392f2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6106697f-844f-4ddb-824a-d5877f392f2d', 'volume_size': 1} Sep 25 17:16:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:21 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 1073741824" returned: 0 in 0.632s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:21 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 Sep 25 17:16:21 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:21 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1384165374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6106697f-844f-4ddb-824a-d5877f392f2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5394abd11d4a0ba4f9efa0b5259b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:21Z,use_quota=True,user_id='abebcd8e5b6149198a16c91dcf4c250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Creating volume 6106697f-844f-4ddb-824a-d5877f392f2d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:21 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:21 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d 1073741824 Sep 25 17:16:21 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Attempting download of fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume 584dfe69-6942-4759-81cc-a6aa2bb45201. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d399e52d-6afc-491e-b249-e491ae5d5e34]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_66ivodqo {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:21 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_66ivodqo Sep 25 17:16:21 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (15ebe56b-bcf8-4d02-b6a2-dcdf20c01dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec9a47d-0b0a-44d0-9a31-363833a6c8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec9a47d-0b0a-44d0-9a31-363833a6c8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-880145180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52e9d92-a944-4f6e-995e-83aa6074dc2b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:22Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d118e7-ad19-4c21-a1fa-173165aa2044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d118e7-ad19-4c21-a1fa-173165aa2044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80be5dcd-d11c-405b-9fd5-440d40f6a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Flow 'volume_create_manager' (5d5540a7-b6ff-4cfe-bbff-48c582aa448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b526f32-8933-4331-b630-ed1770382a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b526f32-8933-4331-b630-ed1770382a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2024850772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db036e9-b195-469a-8375-6aaa5101449c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76198a77a63e4eedb4c790a0273ad49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1d3ae7c-b792-40de-b960-33d8eb9e8346,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:22Z,use_quota=True,user_id='97d6c9ced15444859126945b6ee4e47f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3268adff-57cc-447a-8308-bf5654a70139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3268adff-57cc-447a-8308-bf5654a70139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c079c6-1b69-47af-8c94-97987b90d183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c079c6-1b69-47af-8c94-97987b90d183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6db036e9-b195-469a-8375-6aaa5101449c', 'volume_name': 'volume-6db036e9-b195-469a-8375-6aaa5101449c', 'volume_size': 1, 'snapshot_id': 'd1d3ae7c-b792-40de-b960-33d8eb9e8346'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7583fc6-6b81-47eb-a729-1aa84d67e134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7583fc6-6b81-47eb-a729-1aa84d67e134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0793959b-aaed-41e5-9c9b-904e6c1b2d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Volume 6db036e9-b195-469a-8375-6aaa5101449c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6db036e9-b195-469a-8375-6aaa5101449c', 'volume_size': 1, 'snapshot_id': 'd1d3ae7c-b792-40de-b960-33d8eb9e8346'} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:21 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_66ivodqo" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_66ivodqo {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:22 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d 1073741824" returned: 0 in 0.575s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:22 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_66ivodqo Sep 25 17:16:22 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:22 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d Sep 25 17:16:22 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80be5dcd-d11c-405b-9fd5-440d40f6a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b52e9d92-a944-4f6e-995e-83aa6074dc2b', 'volume_name': 'volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8a50b7-d044-4c40-a54b-b9096d04517c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8a50b7-d044-4c40-a54b-b9096d04517c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d1cfe7-c2f7-4234-862b-90594177a4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Volume b52e9d92-a944-4f6e-995e-83aa6074dc2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Trying to clone b52e9d92-a944-4f6e-995e-83aa6074dc2b from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:16:22 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_66ivodqo" returned: 1 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_66ivodqo' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dbcddd-011b-482b-993a-49249a8ca129]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:22 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d" returned: 0 in 0.291s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.430s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "cinder-quobyte-d1d3ae7c-b792-40de-b960-33d8eb9e8346-6db036e9-b195-469a-8375-6aaa5101449c" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf9ff50-8c35-4a51-a5de-83e7d0de5094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6106697f-844f-4ddb-824a-d5877f392f2d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dcd309-a1fc-4d48-9a00-fdf98c78ee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-d1d3ae7c-b792-40de-b960-33d8eb9e8346-6db036e9-b195-469a-8375-6aaa5101449c" acquired by "_create_volume_from_snapshot" :: waited 0.107s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Creating volume 6db036e9-b195-469a-8375-6aaa5101449c from snapshot d1d3ae7c-b792-40de-b960-33d8eb9e8346 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "cinder-quobyte-6db036e9-b195-469a-8375-6aaa5101449c" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Volume volume-6106697f-844f-4ddb-824a-d5877f392f2d (6106697f-844f-4ddb-824a-d5877f392f2d): created successfully Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dcd309-a1fc-4d48-9a00-fdf98c78ee74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Flow 'volume_create_manager' (4509d614-25c4-48b7-8bbb-d7658d6b20a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:22 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD Sep 25 17:16:22 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-6db036e9-b195-469a-8375-6aaa5101449c" acquired by "_copy_volume_from_snapshot" :: waited 0.067s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] snapshot: d1d3ae7c-b792-40de-b960-33d8eb9e8346, volume: 6db036e9-b195-469a-8375-6aaa5101449c, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:16:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ac425f74-1dc5-4aea-bef9-6e164066164e tempest-VolumesListAdminTestJSON-1597165539 None] Created volume successfully. Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cc59a1-67b4-445c-94ef-08a55d93e5ea]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:16:22 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Image download 20.69 MB at 20.69 MB/s Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e1ebb-c550-4a8d-b036-fcde3593cd1e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:22 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 Sep 25 17:16:22 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:22 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD" returned: 0 in 0.513s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] fe054675-e641-4e31-bdb5-5e70f8a00fc9 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:16:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:22 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 Sep 25 17:16:22 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:22 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD Sep 25 17:16:22 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:23 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346" returned: 0 in 0.546s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9ad031d-82bf-4d7c-b455-17494d26138e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8a5a21-9ad7-4209-99e8-e525c7c1fdf5]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:23 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 is fetched for user 17604032b45e416f8809b24e6a71733d. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5f8467-ff80-4ed9-96af-ca5f989b3c2e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:23 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e Sep 25 17:16:23 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Flow 'volume_create_manager' (08bc93a9-021a-4ccd-aea4-f127d86f1e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8542db-43b2-41f7-aa68-15fc0c52c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8542db-43b2-41f7-aa68-15fc0c52c679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-948730482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c3c367-da1a-48b5-ab21-d22e7b4f4806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5394abd11d4a0ba4f9efa0b5259b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:23Z,use_quota=True,user_id='abebcd8e5b6149198a16c91dcf4c250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf673a5-9a2d-4b71-a2a8-92595a9096ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf673a5-9a2d-4b71-a2a8-92595a9096ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b50b9a2-d567-480d-992a-2aee4acad634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b50b9a2-d567-480d-992a-2aee4acad634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c3c367-da1a-48b5-ab21-d22e7b4f4806', 'volume_name': 'volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:23 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8ec5a4-d1c1-4662-972a-338a137b4ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:23 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8ec5a4-d1c1-4662-972a-338a137b4ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9da4fe-41eb-47b0-94cb-bd6a0a60c8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Volume e6c3c367-da1a-48b5-ab21-d22e7b4f4806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806', 'volume_size': 1} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:23 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e" returned: 0 in 0.563s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:23 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c Sep 25 17:16:23 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:23 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:26 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201" returned: 0 in 3.946s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:26 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_lil1lvl1devstack@QuobyteHD, size 112.00 MB, duration 3.95 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:16:26 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Converted 112.00 MB image at 28.37 MB/s Sep 25 17:16:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:26 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 1G Sep 25 17:16:26 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:27 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 1G" returned: 0 in 0.573s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Downloaded image fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume 584dfe69-6942-4759-81cc-a6aa2bb45201 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 for user adae382da2e342c6866df77f250652f7 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Marking volume 584dfe69-6942-4759-81cc-a6aa2bb45201 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Copying metadata from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 to 584dfe69-6942-4759-81cc-a6aa2bb45201. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Creating volume glance metadata for volume 584dfe69-6942-4759-81cc-a6aa2bb45201 backed by image fe054675-e641-4e31-bdb5-5e70f8a00fc9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e290df-558b-4969-9a20-59dee85a43f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584dfe69-6942-4759-81cc-a6aa2bb45201', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dccbcb-fdfd-495b-ae35-a1ad6512577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:27 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Volume volume-584dfe69-6942-4759-81cc-a6aa2bb45201 (584dfe69-6942-4759-81cc-a6aa2bb45201): created successfully Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dccbcb-fdfd-495b-ae35-a1ad6512577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Flow 'volume_create_manager' (3730be92-1617-44bb-8616-85ce7dbd3f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-832c549b-79e8-46e5-a288-17c0cc6bde9f tempest-TestShelveInstance-775014126 None] Created volume successfully. Sep 25 17:16:31 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c" returned: 0 in 7.553s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:16:31 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Converted 1024.00 MB image at 135.56 MB/s Sep 25 17:16:31 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c is being set with open permissions: ugo+rw Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:31 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c Sep 25 17:16:31 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:31 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c" returned: 0 in 0.300s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-6db036e9-b195-469a-8375-6aaa5101449c" released by "_copy_volume_from_snapshot" :: held 9.106s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-d1d3ae7c-b792-40de-b960-33d8eb9e8346-6db036e9-b195-469a-8375-6aaa5101449c" released by "_create_volume_from_snapshot" :: held 9.246s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.358s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.082s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-948730482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c3c367-da1a-48b5-ab21-d22e7b4f4806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5394abd11d4a0ba4f9efa0b5259b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:23Z,use_quota=True,user_id='abebcd8e5b6149198a16c91dcf4c250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Creating volume e6c3c367-da1a-48b5-ab21-d22e7b4f4806 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:31 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:31 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 1073741824 Sep 25 17:16:31 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0793959b-aaed-41e5-9c9b-904e6c1b2d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db036e9-b195-469a-8375-6aaa5101449c', 'volume_size': 1, 'snapshot_id': 'd1d3ae7c-b792-40de-b960-33d8eb9e8346'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d568660b-a8b7-4c7e-ab0d-6866272d421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:31 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Volume volume-6db036e9-b195-469a-8375-6aaa5101449c (6db036e9-b195-469a-8375-6aaa5101449c): created successfully Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d568660b-a8b7-4c7e-ab0d-6866272d421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:31 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Flow 'volume_create_manager' (5d5540a7-b6ff-4cfe-bbff-48c582aa448a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9b3819d2-7c7a-4123-89c9-2683466d424f tempest-VolumeDependencyTests-1395054317 None] Created volume successfully. Sep 25 17:16:32 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 1073741824" returned: 0 in 0.693s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=131,cinder:UPDATE=182,cinder:INSERT=44,cinder:DELETE=20 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:INSERT=54,cinder:SELECT=133,cinder:UPDATE=183,cinder:DELETE=13 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:32 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 Sep 25 17:16:32 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-893d2b46-c7bc-484b-ba33-738fdbfd092a req-ff65d718-403c-4ecc-b12f-6da0677f8c76 tempest-TestShelveInstance-775014126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "cinder-d1d3ae7c-b792-40de-b960-33d8eb9e8346-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-d1d3ae7c-b792-40de-b960-33d8eb9e8346-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "cinder-quobyte-e9ad031d-82bf-4d7c-b455-17494d26138e" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-e9ad031d-82bf-4d7c-b455-17494d26138e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "cinder-quobyte-d1d3ae7c-b792-40de-b960-33d8eb9e8346" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-d1d3ae7c-b792-40de-b960-33d8eb9e8346" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Deleting offline snapshot d1d3ae7c-b792-40de-b960-33d8eb9e8346 of volume e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:16:32 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] snapshot_file for this snap is: volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806" returned: 0 in 0.355s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.874s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-880145180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52e9d92-a944-4f6e-995e-83aa6074dc2b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:22Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Creating volume b52e9d92-a944-4f6e-995e-83aa6074dc2b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:32 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a07cac-857d-4705-9e3f-b2d34a35b000]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:32 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b 1073741824 Sep 25 17:16:32 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9da4fe-41eb-47b0-94cb-bd6a0a60c8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20409024-bc05-43e8-954c-9d9cf92426b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Volume volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 (e6c3c367-da1a-48b5-ab21-d22e7b4f4806): created successfully Sep 25 17:16:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20409024-bc05-43e8-954c-9d9cf92426b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Flow 'volume_create_manager' (08bc93a9-021a-4ccd-aea4-f127d86f1e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-631babb7-d709-4311-9be4-4dd52e5cfb69 tempest-VolumesListAdminTestJSON-1597165539 None] Created volume successfully. Sep 25 17:16:33 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 Sep 25 17:16:33 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:33 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346" returned: 0 in 0.625s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9ad031d-82bf-4d7c-b455-17494d26138e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:16:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7bd3da-67af-4d52-b034-74d1f50ff76e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:33 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b 1073741824" returned: 0 in 0.757s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:33 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e Sep 25 17:16:33 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:33 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b Sep 25 17:16:33 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:34 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b" returned: 0 in 0.439s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-893d2b46-c7bc-484b-ba33-738fdbfd092a req-ff65d718-403c-4ecc-b12f-6da0677f8c76 tempest-TestShelveInstance-775014126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.575s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-893d2b46-c7bc-484b-ba33-738fdbfd092a req-ff65d718-403c-4ecc-b12f-6da0677f8c76 tempest-TestShelveInstance-775014126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.066s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Attempting download of fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume b52e9d92-a944-4f6e-995e-83aa6074dc2b. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Flow 'volume_create_manager' (f653dff2-3156-4c4a-ad0b-475c384b6b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87baefe0-06e7-48b4-8e5f-a4dbe2dd9963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87baefe0-06e7-48b4-8e5f-a4dbe2dd9963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1468690349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f31c9c-1da2-443d-96ad-1b2089a05fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5394abd11d4a0ba4f9efa0b5259b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:34Z,use_quota=True,user_id='abebcd8e5b6149198a16c91dcf4c250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a774b0-f6b3-4201-a0c6-81330793817a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a774b0-f6b3-4201-a0c6-81330793817a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525c2770-5161-41c3-a770-9edf663fed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525c2770-5161-41c3-a770-9edf663fed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f31c9c-1da2-443d-96ad-1b2089a05fa2', 'volume_name': 'volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3edb52-bc22-4727-befa-0dae9395692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3edb52-bc22-4727-befa-0dae9395692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686830da-3360-478d-a5b8-b93d692410b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Volume b0f31c9c-1da2-443d-96ad-1b2089a05fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2', 'volume_size': 1} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1468690349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f31c9c-1da2-443d-96ad-1b2089a05fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5394abd11d4a0ba4f9efa0b5259b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:34Z,use_quota=True,user_id='abebcd8e5b6149198a16c91dcf4c250a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Creating volume b0f31c9c-1da2-443d-96ad-1b2089a05fa2 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:34 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:34 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe80c02-36b1-4c19-a4c9-4206d4d5cc76]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-893d2b46-c7bc-484b-ba33-738fdbfd092a req-ff65d718-403c-4ecc-b12f-6da0677f8c76 tempest-TestShelveInstance-775014126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-584dfe69-6942-4759-81cc-a6aa2bb45201', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6da5b639-a610-4a05-9062-5532ff35fd1f', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_tfxjno2q {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:34 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 1073741824 Sep 25 17:16:34 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e" returned: 0 in 0.901s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:34 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 Sep 25 17:16:34 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:34 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_tfxjno2q Sep 25 17:16:34 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-893d2b46-c7bc-484b-ba33-738fdbfd092a req-ff65d718-403c-4ecc-b12f-6da0677f8c76 tempest-TestShelveInstance-775014126 None] attachment_update completed successfully. Sep 25 17:16:34 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_tfxjno2q" returned: 0 in 0.484s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_tfxjno2q {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:35 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:35 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346 Sep 25 17:16:35 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:35 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 1073741824" returned: 0 in 0.704s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:35 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_tfxjno2q Sep 25 17:16:35 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:35 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 Sep 25 17:16:35 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:35 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e.d1d3ae7c-b792-40de-b960-33d8eb9e8346" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:35 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-d1d3ae7c-b792-40de-b960-33d8eb9e8346" released by "_delete_snapshot" :: held 2.682s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_tfxjno2q" returned: 1 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe054675-e641-4e31-bdb5-5e70f8a00fc9_tfxjno2q' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12b4224-144f-4863-af2e-09999f1d51c5]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-e9ad031d-82bf-4d7c-b455-17494d26138e" released by "delete_snapshot" :: held 2.753s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:35 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Created reservations ['a8634532-71d6-4922-ae8b-8238c8729ef0', '8c59e64f-4803-4969-8909-33bb4c82200e', 'f7432eea-34d6-4770-b67d-adeb0b4e0a11', '1f97bf08-dc5f-46a0-aa33-c62b38d47711'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2" returned: 0 in 0.464s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:35 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD Sep 25 17:16:35 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686830da-3360-478d-a5b8-b93d692410b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef02bfcb-81ef-4609-af9b-ee325b2d2ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Volume volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 (b0f31c9c-1da2-443d-96ad-1b2089a05fa2): created successfully Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef02bfcb-81ef-4609-af9b-ee325b2d2ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Flow 'volume_create_manager' (f653dff2-3156-4c4a-ad0b-475c384b6b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dcad1182-e31c-48a8-82a4-fba570c1157f tempest-VolumesListAdminTestJSON-1597165539 None] Created volume successfully. Sep 25 17:16:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Delete snapshot completed successfully. Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f77e6449-4f8c-477f-bc69-9bd91a5e7d30 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-d1d3ae7c-b792-40de-b960-33d8eb9e8346-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:35 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] fe054675-e641-4e31-bdb5-5e70f8a00fc9 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:16:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:36 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b Sep 25 17:16:36 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "cinder-e9ad031d-82bf-4d7c-b455-17494d26138e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-e9ad031d-82bf-4d7c-b455-17494d26138e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "cinder-quobyte-e9ad031d-82bf-4d7c-b455-17494d26138e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-e9ad031d-82bf-4d7c-b455-17494d26138e" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4ae80-62da-4c91-a48e-ac3a337cc3da]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:36 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e Sep 25 17:16:36 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:37 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e" returned: 0 in 0.567s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:37 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e Sep 25 17:16:37 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:37 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e9ad031d-82bf-4d7c-b455-17494d26138e" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-e9ad031d-82bf-4d7c-b455-17494d26138e" released by "delete_volume" :: held 1.118s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Flow 'volume_create_manager' (09109810-5915-4e5e-aad2-4fe161f2be53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41707e45-1868-4b32-821f-36b7a6e62f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Created reservations ['51248afe-c9f8-45db-9bf4-b5b6a88c1ace', '47712754-c40c-4915-b062-f5e14b757443', 'e887d3b9-d282-430b-b863-e9c95411ba47', 'becb1611-f897-48ec-829e-79e4fe4ec64e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41707e45-1868-4b32-821f-36b7a6e62f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70482a6-acbc-4781-8cc1-83a15e7571a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f7bb2169194efba36125c9757223d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:38Z,use_quota=True,user_id='53465c9f540c4f00a4e451c0de01c88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b3c543-fc94-4dd8-a182-654eddf6b5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b3c543-fc94-4dd8-a182-654eddf6b5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f352f2fe-61af-45ff-bbeb-5743a841d8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f352f2fe-61af-45ff-bbeb-5743a841d8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70482a6-acbc-4781-8cc1-83a15e7571a0', 'volume_name': 'volume-f70482a6-acbc-4781-8cc1-83a15e7571a0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f66551-71bd-4484-a712-4f1ea5e67c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f66551-71bd-4484-a712-4f1ea5e67c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d027ab32-c3ad-4562-8d42-59021dd7d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Volume f70482a6-acbc-4781-8cc1-83a15e7571a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70482a6-acbc-4781-8cc1-83a15e7571a0', 'volume_size': 1} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70482a6-acbc-4781-8cc1-83a15e7571a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f7bb2169194efba36125c9757223d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:38Z,use_quota=True,user_id='53465c9f540c4f00a4e451c0de01c88c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Creating volume f70482a6-acbc-4781-8cc1-83a15e7571a0 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:37 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:37 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 1073741824 Sep 25 17:16:37 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:38 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:38 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:38 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.609s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Deleted volume successfully. Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47760746-add3-43bf-826d-9c280e446a16 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-e9ad031d-82bf-4d7c-b455-17494d26138e-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "cinder-6db036e9-b195-469a-8375-6aaa5101449c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-6db036e9-b195-469a-8375-6aaa5101449c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "cinder-quobyte-6db036e9-b195-469a-8375-6aaa5101449c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:38 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-6db036e9-b195-469a-8375-6aaa5101449c" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 1073741824" returned: 0 in 1.138s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c078f2f-48e3-4b5a-a776-b61ccff622c6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:39 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 Sep 25 17:16:39 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:39 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b" returned: 0 in 3.345s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe054675-e641-4e31-bdb5-5e70f8a00fc9_107ob5fhdevstack@QuobyteHD, size 112.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:16:39 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Converted 112.00 MB image at 33.47 MB/s Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:39 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c Sep 25 17:16:39 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:39 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b 1G Sep 25 17:16:39 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:39 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0" returned: 0 in 0.539s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d027ab32-c3ad-4562-8d42-59021dd7d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70482a6-acbc-4781-8cc1-83a15e7571a0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7475968-7545-4e4e-82af-df47751e3e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Volume volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 (f70482a6-acbc-4781-8cc1-83a15e7571a0): created successfully Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7475968-7545-4e4e-82af-df47751e3e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Flow 'volume_create_manager' (09109810-5915-4e5e-aad2-4fe161f2be53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:39 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c" returned: 0 in 0.745s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-233603a4-8201-48f8-b6f2-333a1a1a318a tempest-VolumesListAdminTestJSON-536714983 None] Created volume successfully. Sep 25 17:16:39 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c Sep 25 17:16:39 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:39 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b 1G" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Downloaded image fe054675-e641-4e31-bdb5-5e70f8a00fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}])) to volume b52e9d92-a944-4f6e-995e-83aa6074dc2b successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Temporary image fe054675-e641-4e31-bdb5-5e70f8a00fc9 for user 17604032b45e416f8809b24e6a71733d is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Marking volume b52e9d92-a944-4f6e-995e-83aa6074dc2b as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Copying metadata from image fe054675-e641-4e31-bdb5-5e70f8a00fc9 to b52e9d92-a944-4f6e-995e-83aa6074dc2b. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:16:39 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Creating volume glance metadata for volume b52e9d92-a944-4f6e-995e-83aa6074dc2b backed by image fe054675-e641-4e31-bdb5-5e70f8a00fc9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d1cfe7-c2f7-4234-862b-90594177a4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b', 'volume_size': 1, 'image_id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'caf1a66ba6df4fdf9315ba97bbca3eb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fe054675-e641-4e31-bdb5-5e70f8a00fc9', 'created_at': datetime.datetime(2026, 9, 25, 14, 55, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 14, 55, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe054675-e641-4e31-bdb5-5e70f8a00fc9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae5647e-be59-4e97-9d10-1ec08fa7c139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Volume volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b (b52e9d92-a944-4f6e-995e-83aa6074dc2b): created successfully Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae5647e-be59-4e97-9d10-1ec08fa7c139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (15ebe56b-bcf8-4d02-b6a2-dcdf20c01dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:40 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6db036e9-b195-469a-8375-6aaa5101449c" returned: 0 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e7a1821b-d812-4ea1-b136-9dbfccf1c5e6 tempest-VolumesGetTest-1790645599 None] Created volume successfully. Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-quobyte-6db036e9-b195-469a-8375-6aaa5101449c" released by "delete_volume" :: held 1.173s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Created reservations ['f142d6f9-3ee3-4daa-b872-2c1988f613a8', 'dc80f52a-38ad-45fc-85f1-558bb7aa6eba', 'ab82044b-15ad-4b37-93d2-e14d54b97125', '496b5045-90f6-4e2b-b8cb-ec7df9883f45'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:40 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:40 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:40 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.335s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Deleted volume successfully. Sep 25 17:16:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-213bb4f6-224d-4a4f-a560-1cab63fbc5e6 tempest-VolumeDependencyTests-1395054317 None] Lock "cinder-6db036e9-b195-469a-8375-6aaa5101449c-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Acquiring lock "cinder-f70482a6-acbc-4781-8cc1-83a15e7571a0-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Lock "cinder-f70482a6-acbc-4781-8cc1-83a15e7571a0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Acquiring lock "cinder-quobyte-f70482a6-acbc-4781-8cc1-83a15e7571a0" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Lock "cinder-quobyte-f70482a6-acbc-4781-8cc1-83a15e7571a0" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5910ee5-9f8d-4d94-8aa7-89e0e468573c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "cinder-b0f31c9c-1da2-443d-96ad-1b2089a05fa2-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-b0f31c9c-1da2-443d-96ad-1b2089a05fa2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "cinder-quobyte-b0f31c9c-1da2-443d-96ad-1b2089a05fa2" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-quobyte-b0f31c9c-1da2-443d-96ad-1b2089a05fa2" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:41 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 Sep 25 17:16:41 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdbd861-778b-4254-9c00-e23f789d49e2]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:42 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 Sep 25 17:16:42 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:42 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0" returned: 0 in 0.851s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:42 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0 Sep 25 17:16:42 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (95ca1e03-6f57-4ca1-98ff-168e0547f8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0f8d2c-b7ea-4eae-bb90-b49a0fe457c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0f8d2c-b7ea-4eae-bb90-b49a0fe457c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1216463413',display_name='tempest-VolumesGetTest-Volume-476689333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993f55db-03a3-4e08-b3a4-e1550c073d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:42Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:42 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d73b967-fc6c-476d-8a35-9d09d16f3b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d73b967-fc6c-476d-8a35-9d09d16f3b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a16cd3a-b249-417b-8496-ce82bb06d965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a16cd3a-b249-417b-8496-ce82bb06d965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993f55db-03a3-4e08-b3a4-e1550c073d46', 'volume_name': 'volume-993f55db-03a3-4e08-b3a4-e1550c073d46', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfced043-2e4c-48ba-b12b-972eba567d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfced043-2e4c-48ba-b12b-972eba567d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f466292a-c888-4ac7-8a29-3c74efc59714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Volume 993f55db-03a3-4e08-b3a4-e1550c073d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993f55db-03a3-4e08-b3a4-e1550c073d46', 'volume_size': 1} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:42 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1216463413',display_name='tempest-VolumesGetTest-Volume-476689333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993f55db-03a3-4e08-b3a4-e1550c073d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e581fb87e9b4ebf8a996ec3f1c3c0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:42Z,use_quota=True,user_id='17604032b45e416f8809b24e6a71733d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Creating volume 993f55db-03a3-4e08-b3a4-e1550c073d46 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:42 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f70482a6-acbc-4781-8cc1-83a15e7571a0" returned: 0 in 0.445s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2" returned: 0 in 1.031s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:42 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46 1073741824 Sep 25 17:16:42 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Lock "cinder-quobyte-f70482a6-acbc-4781-8cc1-83a15e7571a0" released by "delete_volume" :: held 1.409s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:42 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2 Sep 25 17:16:42 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:42 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Created reservations ['7af6844e-8cd1-469b-a36f-294f10da98be', '30c5135e-21f3-4ca6-9488-1048be5326e0', '0647207e-d700-4d3c-8971-97a72686f781', '3bfb2e71-7412-4424-96c1-abaadfa6b64d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:43 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:43 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:43 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b0f31c9c-1da2-443d-96ad-1b2089a05fa2" returned: 0 in 0.681s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-quobyte-b0f31c9c-1da2-443d-96ad-1b2089a05fa2" released by "delete_volume" :: held 1.835s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Created reservations ['408a6c98-f1be-4fb0-906f-acdfec18de7a', 'aab9ec40-dd96-4f9d-ad12-86e3cbe61c66', '37ece1ad-e686-4f32-ae14-df86f7534df2', 'b5b65219-c966-4520-adcf-5ee816c65aea'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:43 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46 1073741824" returned: 0 in 0.961s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:43 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.583s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Deleted volume successfully. Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:43 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46 Sep 25 17:16:43 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-47525671-447a-4896-90ab-518265b4051c tempest-VolumesListAdminTestJSON-536714983 None] Lock "cinder-f70482a6-acbc-4781-8cc1-83a15e7571a0-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:43 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:43 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "cinder-e6c3c367-da1a-48b5-ab21-d22e7b4f4806-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-e6c3c367-da1a-48b5-ab21-d22e7b4f4806-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:44 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.557s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Deleted volume successfully. Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "cinder-quobyte-e6c3c367-da1a-48b5-ab21-d22e7b4f4806" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9f469a62-085e-4ef5-befe-0179a0b89eca tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-b0f31c9c-1da2-443d-96ad-1b2089a05fa2-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-quobyte-e6c3c367-da1a-48b5-ab21-d22e7b4f4806" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[787aecff-8c61-4b27-aae8-fd6e3bc5e259]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:44 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46" returned: 0 in 0.842s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f466292a-c888-4ac7-8a29-3c74efc59714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993f55db-03a3-4e08-b3a4-e1550c073d46', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497f6fc4-cca2-4b21-9736-4bca1f70f3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:44 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Volume volume-993f55db-03a3-4e08-b3a4-e1550c073d46 (993f55db-03a3-4e08-b3a4-e1550c073d46): created successfully Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497f6fc4-cca2-4b21-9736-4bca1f70f3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Flow 'volume_create_manager' (95ca1e03-6f57-4ca1-98ff-168e0547f8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0c8dbfd8-a457-4079-b163-80ebb5dfbe83 tempest-VolumesGetTest-1790645599 None] Created volume successfully. Sep 25 17:16:44 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 Sep 25 17:16:44 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:45 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806" returned: 0 in 0.683s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:45 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806 Sep 25 17:16:45 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:45 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e6c3c367-da1a-48b5-ab21-d22e7b4f4806" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-quobyte-e6c3c367-da1a-48b5-ab21-d22e7b4f4806" released by "delete_volume" :: held 1.330s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:45 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Created reservations ['fbf37f51-4c51-4b12-a2d6-7b98a6cf1e8c', 'e2474f0a-66fc-4288-bd7f-c8fd1651c3c4', '2fa98f93-6b30-4a96-a5f7-9c4c11591983', 'afc0c56c-3acc-4cff-b875-3bc3a0c674a2'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-993f55db-03a3-4e08-b3a4-e1550c073d46-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Lock "cinder-993f55db-03a3-4e08-b3a4-e1550c073d46-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-quobyte-993f55db-03a3-4e08-b3a4-e1550c073d46" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-993f55db-03a3-4e08-b3a4-e1550c073d46" acquired by "delete_volume" :: waited 0.080s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:46 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:46 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3d8002-65bd-41b9-9caa-a7dddeaa15ee]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:46 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46 Sep 25 17:16:46 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:46 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.637s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Deleted volume successfully. Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "cinder-6106697f-844f-4ddb-824a-d5877f392f2d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-6106697f-844f-4ddb-824a-d5877f392f2d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b94443e4-48f2-4e17-b259-61d90aa98119 tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-e6c3c367-da1a-48b5-ab21-d22e7b4f4806-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "cinder-quobyte-6106697f-844f-4ddb-824a-d5877f392f2d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-quobyte-6106697f-844f-4ddb-824a-d5877f392f2d" acquired by "delete_volume" :: waited 0.044s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6da6bb-80e8-4a0e-8673-7fee8a03daaf]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:47 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46" returned: 0 in 0.893s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:47 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46 Sep 25 17:16:47 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:47 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d Sep 25 17:16:47 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:47 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-993f55db-03a3-4e08-b3a4-e1550c073d46" returned: 0 in 0.564s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-993f55db-03a3-4e08-b3a4-e1550c073d46" released by "delete_volume" :: held 1.560s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Created reservations ['ad5a5f36-76bf-4725-856e-df78e24296c7', '56ccb506-4904-47c1-a14c-1d393802de94', 'f8c21ce4-111d-4882-b161-35d88c949f3f', '5b101a8d-b4e1-45ad-8c0f-392f098dac0c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:47 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d" returned: 0 in 0.799s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:48 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d Sep 25 17:16:48 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:48 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:48 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:48 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Deleted volume successfully. Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5d30af41-59d2-4278-95eb-9b81173913ca tempest-VolumesGetTest-1790645599 None] Lock "cinder-993f55db-03a3-4e08-b3a4-e1550c073d46-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-b52e9d92-a944-4f6e-995e-83aa6074dc2b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:48 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6106697f-844f-4ddb-824a-d5877f392f2d" returned: 0 in 0.663s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Lock "cinder-b52e9d92-a944-4f6e-995e-83aa6074dc2b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-quobyte-6106697f-844f-4ddb-824a-d5877f392f2d" released by "delete_volume" :: held 1.579s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Acquiring lock "cinder-quobyte-b52e9d92-a944-4f6e-995e-83aa6074dc2b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-b52e9d92-a944-4f6e-995e-83aa6074dc2b" acquired by "delete_volume" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4137472-091c-45be-831c-007ddc0a9cce]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Created reservations ['1d02676b-ec5f-429b-a055-87143535e098', '9b0f5e93-5f94-419a-976e-6b43affdeff5', 'dc1dd3fe-07fb-412f-8db0-613dc1c9cc77', '068350d8-8025-462c-9522-bb0ea6d5d933'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:49 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b Sep 25 17:16:49 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:49 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:49 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:49 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b" returned: 0 in 0.667s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:49 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b Sep 25 17:16:49 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:49 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.565s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Deleted volume successfully. Sep 25 17:16:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cad816df-8960-44bc-a9b0-ed20a883fe2b tempest-VolumesListAdminTestJSON-1597165539 None] Lock "cinder-6106697f-844f-4ddb-824a-d5877f392f2d-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:49 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b52e9d92-a944-4f6e-995e-83aa6074dc2b" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Lock "cinder-quobyte-b52e9d92-a944-4f6e-995e-83aa6074dc2b" released by "delete_volume" :: held 1.267s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Created reservations ['b4114e61-4f53-4f50-b13d-5aab08d009c9', 'c5423a76-00a5-4adb-8414-1a0661d0ef8c', '75337265-897d-4a56-8d99-a637e6ff5562', 'ddee42ec-c60f-48dc-a1ff-680568aaf53b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:50 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:50 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Flow 'volume_create_manager' (3f97ebe9-7235-4184-982d-98f6d8ffba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828c3c8a-8df5-4182-9dfc-f437b1067e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828c3c8a-8df5-4182-9dfc-f437b1067e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104585637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad83f0b2-30e1-4895-94df-d72b238bfa20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eddb3f94d0e452594559bd048064f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:50Z,use_quota=True,user_id='d7fb06caf4ab43f691c97260ccb8ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9b151e-448e-458d-ae5f-b333dddc1f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9b151e-448e-458d-ae5f-b333dddc1f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ac1bc0-b30a-465e-a094-8f1cd7e9ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ac1bc0-b30a-465e-a094-8f1cd7e9ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad83f0b2-30e1-4895-94df-d72b238bfa20', 'volume_name': 'volume-ad83f0b2-30e1-4895-94df-d72b238bfa20', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5464b7-cb96-4bda-bc94-8d1cb427e2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5464b7-cb96-4bda-bc94-8d1cb427e2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5122e22c-f4be-4cac-a9fc-3167afa50f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Volume ad83f0b2-30e1-4895-94df-d72b238bfa20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad83f0b2-30e1-4895-94df-d72b238bfa20', 'volume_size': 1} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104585637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad83f0b2-30e1-4895-94df-d72b238bfa20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eddb3f94d0e452594559bd048064f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:50Z,use_quota=True,user_id='d7fb06caf4ab43f691c97260ccb8ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Creating volume ad83f0b2-30e1-4895-94df-d72b238bfa20 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:50 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:50 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 1073741824 Sep 25 17:16:50 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:50 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.395s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Deleted volume successfully. Sep 25 17:16:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7a7e5094-e973-428f-8ad6-dd922f7064dd tempest-VolumesGetTest-1790645599 None] Lock "cinder-b52e9d92-a944-4f6e-995e-83aa6074dc2b-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:51 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 1073741824" returned: 0 in 0.843s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:51 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 Sep 25 17:16:51 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:51 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5122e22c-f4be-4cac-a9fc-3167afa50f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad83f0b2-30e1-4895-94df-d72b238bfa20', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3199b8-a556-412a-afce-deecc12f481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Volume volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 (ad83f0b2-30e1-4895-94df-d72b238bfa20): created successfully Sep 25 17:16:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3199b8-a556-412a-afce-deecc12f481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Flow 'volume_create_manager' (3f97ebe9-7235-4184-982d-98f6d8ffba26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f1826fe0-7998-4933-b9bd-eb9775a224d4 tempest-ProjectReaderTests-186155838 None] Created volume successfully. Sep 25 17:16:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Acquiring lock "cinder-ad83f0b2-30e1-4895-94df-d72b238bfa20-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Lock "cinder-ad83f0b2-30e1-4895-94df-d72b238bfa20-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Acquiring lock "cinder-quobyte-ad83f0b2-30e1-4895-94df-d72b238bfa20" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Lock "cinder-quobyte-ad83f0b2-30e1-4895-94df-d72b238bfa20" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae46548-5384-4d59-85f8-78ecb3ff032f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:53 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 Sep 25 17:16:53 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:53 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20" returned: 0 in 0.555s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:53 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20 Sep 25 17:16:53 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:54 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-ad83f0b2-30e1-4895-94df-d72b238bfa20" returned: 0 in 0.440s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Lock "cinder-quobyte-ad83f0b2-30e1-4895-94df-d72b238bfa20" released by "delete_volume" :: held 1.078s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Created reservations ['51cca423-a429-4dcd-a012-3ec6973bce71', '64c4edfb-5013-4f44-829e-9e4565ddf404', '96343ab3-618e-4367-8ee2-bd4bbedb4f26', 'e88f1ea3-92d6-4f7a-9599-367d6e28b530'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:54 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:54 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:54 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.438s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Deleted volume successfully. Sep 25 17:16:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da83910e-63af-4bc5-bb6b-e21f6e937b1a tempest-ProjectReaderTests-186155838 None] Lock "cinder-ad83f0b2-30e1-4895-94df-d72b238bfa20-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Flow 'volume_create_manager' (a3c9380c-aeab-4273-9bde-5cc97fa2813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5776585-411a-43e8-b646-ac9562c46aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5776585-411a-43e8-b646-ac9562c46aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1802195703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851098b5-a780-4ece-88c4-5276a9e28dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eddb3f94d0e452594559bd048064f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:56Z,use_quota=True,user_id='d7fb06caf4ab43f691c97260ccb8ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57887f4-ebd4-4812-8b5f-93ee5ff7aeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57887f4-ebd4-4812-8b5f-93ee5ff7aeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ff6218-6bae-48b6-a7be-aa489632e85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:56 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ff6218-6bae-48b6-a7be-aa489632e85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '851098b5-a780-4ece-88c4-5276a9e28dcb', 'volume_name': 'volume-851098b5-a780-4ece-88c4-5276a9e28dcb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:56 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b89902-865c-4a2b-a001-1b3c6e2be490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b89902-865c-4a2b-a001-1b3c6e2be490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e11776a-1be9-41f7-98f1-cf37ac945aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Volume 851098b5-a780-4ece-88c4-5276a9e28dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-851098b5-a780-4ece-88c4-5276a9e28dcb', 'volume_size': 1} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1802195703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851098b5-a780-4ece-88c4-5276a9e28dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eddb3f94d0e452594559bd048064f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:56Z,use_quota=True,user_id='d7fb06caf4ab43f691c97260ccb8ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Creating volume 851098b5-a780-4ece-88c4-5276a9e28dcb {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:56 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:56 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb 1073741824 Sep 25 17:16:56 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:56 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.604s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:16:56 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb 1073741824" returned: 0 in 0.649s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:57 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb Sep 25 17:16:57 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:57 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb" returned: 0 in 0.391s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:16:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e11776a-1be9-41f7-98f1-cf37ac945aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-851098b5-a780-4ece-88c4-5276a9e28dcb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98556aef-ad7f-4226-8173-b498c9cce83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Volume volume-851098b5-a780-4ece-88c4-5276a9e28dcb (851098b5-a780-4ece-88c4-5276a9e28dcb): created successfully Sep 25 17:16:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98556aef-ad7f-4226-8173-b498c9cce83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Flow 'volume_create_manager' (a3c9380c-aeab-4273-9bde-5cc97fa2813e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cfb9a5c6-3d49-4fac-b762-81a8fc0ae38a tempest-ProjectReaderTests-186155838 None] Created volume successfully. Sep 25 17:16:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Acquiring lock "cinder-851098b5-a780-4ece-88c4-5276a9e28dcb-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Lock "cinder-851098b5-a780-4ece-88c4-5276a9e28dcb-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Acquiring lock "cinder-quobyte-851098b5-a780-4ece-88c4-5276a9e28dcb" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:16:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Lock "cinder-quobyte-851098b5-a780-4ece-88c4-5276a9e28dcb" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:16:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[927946fa-2756-4d76-aaca-404b02cb6025]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:16:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:58 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb Sep 25 17:16:58 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:58 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:16:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Flow 'volume_create_manager' (30847f36-7e69-40b4-922b-3bfc802389fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:16:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6b6e12-0fde-439f-be7a-28457e3cb00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6b6e12-0fde-439f-be7a-28457e3cb00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-625775372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b73b839-dd50-4e8c-af33-a7dfcfd1bc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941bd0f5506a4d24b00eaad3061ce15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:59Z,use_quota=True,user_id='45ea5c3a58b34731b32fbeea7f1284b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ba0836-2908-4aaa-b7ca-03c7efe7e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ba0836-2908-4aaa-b7ca-03c7efe7e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf71019-fcc2-4d69-915c-ada5f37da8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf71019-fcc2-4d69-915c-ada5f37da8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b73b839-dd50-4e8c-af33-a7dfcfd1bc30', 'volume_name': 'volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ecebf2-59c1-4555-a398-c756aba54f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ecebf2-59c1-4555-a398-c756aba54f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528a2c0a-8896-4fe1-bfe3-fc902116d21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:16:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Volume 8b73b839-dd50-4e8c-af33-a7dfcfd1bc30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30', 'volume_size': 1} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-625775372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b73b839-dd50-4e8c-af33-a7dfcfd1bc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941bd0f5506a4d24b00eaad3061ce15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:16:59Z,use_quota=True,user_id='45ea5c3a58b34731b32fbeea7f1284b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Creating volume 8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:16:59 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:59 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 1073741824 Sep 25 17:16:59 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:59 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb" returned: 0 in 0.637s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:59 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb Sep 25 17:16:59 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:59 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-851098b5-a780-4ece-88c4-5276a9e28dcb" returned: 0 in 0.468s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:59 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 1073741824" returned: 0 in 0.724s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Lock "cinder-quobyte-851098b5-a780-4ece-88c4-5276a9e28dcb" released by "delete_volume" :: held 1.185s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:16:59 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 Sep 25 17:16:59 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:16:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Created reservations ['b8a69535-2978-4ac2-8048-b239f499a2ec', '61b272d0-fe2d-49f8-9040-63a31ffd3b8a', 'a62d2b15-aca9-4163-aa91-c88c78ac086f', '1c0036a8-1c5c-47c4-a1fa-3d760928bf6a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:00 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:17:00 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:00 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" returned: 0 in 0.489s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528a2c0a-8896-4fe1-bfe3-fc902116d21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06beb5e6-3ba5-4447-8e85-8ba0c726eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Volume volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 (8b73b839-dd50-4e8c-af33-a7dfcfd1bc30): created successfully Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06beb5e6-3ba5-4447-8e85-8ba0c726eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Flow 'volume_create_manager' (30847f36-7e69-40b4-922b-3bfc802389fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:00 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f56bcfba-792e-4ffd-8276-99daa4e9a134 tempest-VolumesDeleteCascade-1003652211 None] Created volume successfully. Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.391s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Deleted volume successfully. Sep 25 17:17:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cf20d75-fa8e-47d7-81d2-21e2190a4fde tempest-ProjectReaderTests-186155838 None] Lock "cinder-851098b5-a780-4ece-88c4-5276a9e28dcb-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Creating offline snapshot 61d2e9b9-e65c-4adc-9832-741f50062391 of volume 8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d202f-b7cb-4a46-9533-0836962af74d]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:01 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 Sep 25 17:17:01 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Flow 'volume_create_manager' (11fd3246-155b-476c-8662-21e5b09b78d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9156e3-8df3-4c86-8ae9-e59084a7f618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9156e3-8df3-4c86-8ae9-e59084a7f618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938475352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eddb3f94d0e452594559bd048064f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:01Z,use_quota=True,user_id='d7fb06caf4ab43f691c97260ccb8ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fde8d6-1d1a-4ef7-93af-c4d14724f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fde8d6-1d1a-4ef7-93af-c4d14724f110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0d91cd-2321-4604-96d6-383c9de785d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0d91cd-2321-4604-96d6-383c9de785d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834', 'volume_name': 'volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c68425-6c8a-4e66-b9d3-df19a97b5f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c68425-6c8a-4e66-b9d3-df19a97b5f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aaa0ea-3ed8-493e-bf35-12991d87267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Volume 20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834', 'volume_size': 1} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:01 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" returned: 0 in 0.504s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:01 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 1G Sep 25 17:17:01 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:02 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 1G" returned: 0 in 0.504s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:02 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 Sep 25 17:17:02 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:02 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:02 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 is being set with open permissions: ugo+rw Sep 25 17:17:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:02 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 Sep 25 17:17:02 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:03 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:03 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.info Sep 25 17:17:03 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:03 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.info" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:03 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.info is being set with open permissions: ugo+rw Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:03 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.info Sep 25 17:17:03 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:03 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.info" returned: 0 in 0.267s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.083s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1938475352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eddb3f94d0e452594559bd048064f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:01Z,use_quota=True,user_id='d7fb06caf4ab43f691c97260ccb8ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Creating volume 20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:03 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:17:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:03 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 1073741824 Sep 25 17:17:03 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dd78decb-5b53-4d54-9fc2-bb20cded0253 tempest-VolumesDeleteCascade-1003652211 None] Create snapshot completed successfully Sep 25 17:17:04 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 1073741824" returned: 0 in 0.528s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:04 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 Sep 25 17:17:04 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:04 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834" returned: 0 in 0.369s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Creating offline snapshot 730ebaf7-6495-475e-96d0-2d9055079c19 of volume 8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aaa0ea-3ed8-493e-bf35-12991d87267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1717fbc2-5fb9-4dfe-b783-a5c6192af22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e728524a-49c9-436f-80d7-916caeff5dd0]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Volume volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 (20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834): created successfully Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1717fbc2-5fb9-4dfe-b783-a5c6192af22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Flow 'volume_create_manager' (11fd3246-155b-476c-8662-21e5b09b78d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3afb4070-d5d7-4ecc-9bde-cb3fcf5400b1 tempest-ProjectReaderTests-186155838 None] Created volume successfully. Sep 25 17:17:04 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 Sep 25 17:17:04 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:05 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:05 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 1G Sep 25 17:17:05 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:05 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 1G" returned: 0 in 0.642s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Acquiring lock "cinder-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:05 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 Sep 25 17:17:05 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Lock "cinder-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Acquiring lock "cinder-quobyte-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Lock "cinder-quobyte-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8ded92-c0e0-4d6f-9e8c-da63bd69fa01]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:06 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 Sep 25 17:17:06 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:06 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19" returned: 0 in 0.429s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:06 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 is being set with open permissions: ugo+rw Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:06 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 Sep 25 17:17:06 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:06 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834" returned: 0 in 0.452s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:06 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834 Sep 25 17:17:06 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:06 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19" returned: 0 in 0.313s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-902ef7bf-2759-4db9-b1ac-93cf20127e48 tempest-VolumesDeleteCascade-1003652211 None] Create snapshot completed successfully Sep 25 17:17:06 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834" returned: 0 in 0.331s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Lock "cinder-quobyte-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834" released by "delete_volume" :: held 0.851s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Created reservations ['ca81f711-3b11-4aa5-a2d5-74b7573f7614', '3a021dc7-caee-44e3-a113-af10bd247cd2', 'c141981b-98a5-4e2c-8292-e1ebf309709f', '5eeffa3c-0f66-485b-bd56-5134f52ca662'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Performing cascade delete. {{(pid=87232) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 17:17:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-61d2e9b9-e65c-4adc-9832-741f50062391-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-61d2e9b9-e65c-4adc-9832-741f50062391-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-61d2e9b9-e65c-4adc-9832-741f50062391" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-61d2e9b9-e65c-4adc-9832-741f50062391" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Deleting offline snapshot 61d2e9b9-e65c-4adc-9832-741f50062391 of volume 8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] snapshot_file for this snap is: volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33fe206-9994-48c1-819d-5a049bb3048d]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:07 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:17:07 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:07 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 Sep 25 17:17:07 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:07 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.567s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Deleted volume successfully. Sep 25 17:17:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bc84a3d2-2d99-4cff-8d45-5285e98f7624 tempest-ProjectReaderTests-186155838 None] Lock "cinder-20c8ec6b-9a3e-4f1f-9ad3-e4c2f61d4834-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Flow 'volume_create_manager' (584c0012-5d6d-4351-93cd-36f2d0623e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:08 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d3a2f4-8396-4e23-94de-41e222bddd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391" returned: 0 in 0.806s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d3a2f4-8396-4e23-94de-41e222bddd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-110835675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470cce1e-7620-4688-9d33-6ea151308a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eddb3f94d0e452594559bd048064f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:08Z,use_quota=True,user_id='d7fb06caf4ab43f691c97260ccb8ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76030328-223e-408c-8840-869595a2d5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76030328-223e-408c-8840-869595a2d5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847f84ed-1e85-438d-8881-782995ee6937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847f84ed-1e85-438d-8881-782995ee6937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470cce1e-7620-4688-9d33-6ea151308a8a', 'volume_name': 'volume-470cce1e-7620-4688-9d33-6ea151308a8a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcfa11b-db51-465c-b162-c5ba11b718fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcfa11b-db51-465c-b162-c5ba11b718fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ee8b36-86c9-4db6-b0fc-f3a170505d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Volume 470cce1e-7620-4688-9d33-6ea151308a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470cce1e-7620-4688-9d33-6ea151308a8a', 'volume_size': 1} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-110835675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470cce1e-7620-4688-9d33-6ea151308a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eddb3f94d0e452594559bd048064f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:08Z,use_quota=True,user_id='d7fb06caf4ab43f691c97260ccb8ed58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Creating volume 470cce1e-7620-4688-9d33-6ea151308a8a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:08 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[433921b4-1a10-4124-8657-5a1ca97a3761]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:08 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a 1073741824 Sep 25 17:17:08 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:08 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 Sep 25 17:17:08 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:08 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" returned: 0 in 0.598s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[45abde14-4d42-474f-875c-60967f06f757]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:09 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a 1073741824" returned: 0 in 0.950s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:09 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 Sep 25 17:17:09 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:09 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a Sep 25 17:17:09 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:09 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19" returned: 0 in 0.685s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f47242-f12e-4a8d-aec1-00227e6ebc66]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:09 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a" returned: 0 in 0.517s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ee8b36-86c9-4db6-b0fc-f3a170505d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470cce1e-7620-4688-9d33-6ea151308a8a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f708a8-b2ff-49dd-8562-43a5b4def8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Volume volume-470cce1e-7620-4688-9d33-6ea151308a8a (470cce1e-7620-4688-9d33-6ea151308a8a): created successfully Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f708a8-b2ff-49dd-8562-43a5b4def8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Flow 'volume_create_manager' (584c0012-5d6d-4351-93cd-36f2d0623e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:09 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 Sep 25 17:17:09 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e2b51953-5cf2-479b-baf4-52a513a2e66e tempest-ProjectReaderTests-186155838 None] Created volume successfully. Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Acquiring lock "cinder-470cce1e-7620-4688-9d33-6ea151308a8a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Lock "cinder-470cce1e-7620-4688-9d33-6ea151308a8a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Acquiring lock "cinder-quobyte-470cce1e-7620-4688-9d33-6ea151308a8a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Lock "cinder-quobyte-470cce1e-7620-4688-9d33-6ea151308a8a" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:10 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[925feddd-082a-489b-b14d-b1f9d85c8912]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391" returned: 0 in 0.780s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1392fca0-0bbe-49b7-ba3e-cd8c3d3962ec]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:10 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a Sep 25 17:17:10 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:10 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 Sep 25 17:17:10 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:11 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a" returned: 0 in 0.604s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:11 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a Sep 25 17:17:11 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:11 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" returned: 0 in 0.763s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:11 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 Sep 25 17:17:11 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:11 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-470cce1e-7620-4688-9d33-6ea151308a8a" returned: 0 in 0.602s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Lock "cinder-quobyte-470cce1e-7620-4688-9d33-6ea151308a8a" released by "delete_volume" :: held 1.297s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:11 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Created reservations ['e166d5f4-314f-405a-8b56-c3e947b9d22c', '20d91f6f-bc36-4d12-a856-6e705f1463c9', '47e09c12-bd68-4d99-ac13-f3b5474de275', 'e11e7aa1-0aa9-481a-9ef1-d7e3635aa148'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:12 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:17:12 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:12 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391" returned: 0 in 1.023s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:12 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391 Sep 25 17:17:12 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:12 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:12 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.61d2e9b9-e65c-4adc-9832-741f50062391" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 -F qcow2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Deleted volume successfully. Sep 25 17:17:12 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 -F qcow2 Sep 25 17:17:12 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa6ddb0f-cd02-4fdd-a329-446825c6d407 tempest-ProjectReaderTests-186155838 None] Lock "cinder-470cce1e-7620-4688-9d33-6ea151308a8a-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:13 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 -F qcow2" returned: 0 in 0.478s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-61d2e9b9-e65c-4adc-9832-741f50062391" released by "_delete_snapshot" :: held 6.117s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" released by "delete_snapshot" :: held 6.164s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Created reservations ['f8910bab-a256-46eb-890b-e217dfbb9e0d', 'fff9a3ef-7630-4511-b874-5657dc1f3ec7', '35b37621-50c0-425d-b4a3-98f7f9b7e8f0', 'ff4cf2c9-eb64-4f5d-a6e4-0bb81d832978'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Delete snapshot completed successfully. Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-61d2e9b9-e65c-4adc-9832-741f50062391-delete_snapshot" released by "delete_snapshot" :: held 6.484s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-730ebaf7-6495-475e-96d0-2d9055079c19-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-730ebaf7-6495-475e-96d0-2d9055079c19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-730ebaf7-6495-475e-96d0-2d9055079c19" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-730ebaf7-6495-475e-96d0-2d9055079c19" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Deleting offline snapshot 730ebaf7-6495-475e-96d0-2d9055079c19 of volume 8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] snapshot_file for this snap is: volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fa2e34-dc63-4643-a4ea-c0a67b9d4262]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:13 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 Sep 25 17:17:13 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:14 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19" returned: 0 in 0.507s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba8cdbd-a5c9-401d-97b2-7b3bea9a4f3f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:14 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 Sep 25 17:17:14 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:14 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" returned: 0 in 0.499s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:14 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 Sep 25 17:17:14 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:15 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19" returned: 0 in 0.545s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:15 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19 Sep 25 17:17:15 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:15 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30.730ebaf7-6495-475e-96d0-2d9055079c19" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-730ebaf7-6495-475e-96d0-2d9055079c19" released by "_delete_snapshot" :: held 2.159s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" released by "delete_snapshot" :: held 2.203s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Created reservations ['8aa5e44b-882c-4e61-b617-7390d0fde771', '8b366010-0b7a-48cc-a769-e75167293431', '5540aac2-e2e6-4c30-ac2f-de2a68af60ab', 'c9c660c4-eec7-4d08-9cb6-c4a1f09d9af8'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Delete snapshot completed successfully. Sep 25 17:17:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-730ebaf7-6495-475e-96d0-2d9055079c19-delete_snapshot" released by "delete_snapshot" :: held 2.578s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Snapshots deleted, issuing volume delete {{(pid=87232) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 17:17:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a0db5d-2527-4381-bc1f-a2fcf7f92927]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:16 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 Sep 25 17:17:16 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:16 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:16 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30 Sep 25 17:17:16 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:17 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" returned: 0 in 0.456s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30" released by "delete_volume" :: held 1.174s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Created reservations ['7e027d2f-5655-4525-b78b-b750ebef9536', '366e51ea-e67f-46f2-83b3-69b10f1d3949', '8cb4bbe1-a99c-49f0-bc9d-06db05fa18d0', '0777769d-f478-4a54-9694-87e73bbc076a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:17 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:17:17 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:17 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Deleted volume successfully. Sep 25 17:17:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-803d087d-05c2-4d9b-be66-f755cdbd3286 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-8b73b839-dd50-4e8c-af33-a7dfcfd1bc30-delete_volume" released by "delete_volume" :: held 11.042s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-fec1981a-84ba-4396-8087-152d36878153 req-83946f6a-fbe2-4d4d-acbd-e1339090a117 tempest-TestShelveInstance-775014126 None] Terminate volume connection completed successfully. Sep 25 17:17:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-fec1981a-84ba-4396-8087-152d36878153 req-83946f6a-fbe2-4d4d-acbd-e1339090a117 tempest-TestShelveInstance-775014126 None] Deleting attachment 6da5b639-a610-4a05-9062-5532ff35fd1f. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Flow 'volume_create_manager' (35b67775-0c8c-48b9-9fb9-bda70d4f8558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421ab434-fb32-4f94-83a5-8446de1669ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421ab434-fb32-4f94-83a5-8446de1669ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-544656388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05936742-192c-4f28-a7bd-06b5b14be956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941bd0f5506a4d24b00eaad3061ce15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:20Z,use_quota=True,user_id='45ea5c3a58b34731b32fbeea7f1284b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfe51fa-15a7-4ab7-8b46-1467ea9f48a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfe51fa-15a7-4ab7-8b46-1467ea9f48a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eacd0c0-eed1-4e05-9c4e-7e1876dbfcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eacd0c0-eed1-4e05-9c4e-7e1876dbfcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05936742-192c-4f28-a7bd-06b5b14be956', 'volume_name': 'volume-05936742-192c-4f28-a7bd-06b5b14be956', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61b3656-c0d6-4050-b140-14eac0397b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61b3656-c0d6-4050-b140-14eac0397b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531cc1a7-6423-4c6d-9db6-13d45fb2d67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:19 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Volume 05936742-192c-4f28-a7bd-06b5b14be956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05936742-192c-4f28-a7bd-06b5b14be956', 'volume_size': 1} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-544656388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05936742-192c-4f28-a7bd-06b5b14be956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941bd0f5506a4d24b00eaad3061ce15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:20Z,use_quota=True,user_id='45ea5c3a58b34731b32fbeea7f1284b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Creating volume 05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:19 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:17:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:19 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 1073741824 Sep 25 17:17:19 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:20 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 1073741824" returned: 0 in 0.593s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:20 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 Sep 25 17:17:20 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:20 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956" returned: 0 in 0.334s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:20 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:17:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531cc1a7-6423-4c6d-9db6-13d45fb2d67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05936742-192c-4f28-a7bd-06b5b14be956', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1b899a-6aad-41fd-b4b3-0c300453f756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:20 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Volume volume-05936742-192c-4f28-a7bd-06b5b14be956 (05936742-192c-4f28-a7bd-06b5b14be956): created successfully Sep 25 17:17:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1b899a-6aad-41fd-b4b3-0c300453f756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:20 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Flow 'volume_create_manager' (35b67775-0c8c-48b9-9fb9-bda70d4f8558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-35d02ca9-4b3b-44e2-8c97-9c60b4ed9f23 tempest-VolumesDeleteCascade-1003652211 None] Created volume successfully. Sep 25 17:17:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Creating offline snapshot 65e1e90c-21a1-45b8-b79b-49c4b8534284 of volume 05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:17:22 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1644a8a-0012-495d-99e2-449b48859f97]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-f2ded46f-b304-4f5b-8ae5-bcdbf292fe6a req-be228905-541d-4807-8b0a-f921d6067be8 tempest-TestShelveInstance-775014126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:22 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 Sep 25 17:17:22 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:22 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956" returned: 0 in 0.435s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:22 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 1G Sep 25 17:17:22 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:23 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 1G" returned: 0 in 0.482s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05936742-192c-4f28-a7bd-06b5b14be956 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:23 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05936742-192c-4f28-a7bd-06b5b14be956 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 Sep 25 17:17:23 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:23 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05936742-192c-4f28-a7bd-06b5b14be956 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284" returned: 0 in 0.535s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:23 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 is being set with open permissions: ugo+rw Sep 25 17:17:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:23 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 Sep 25 17:17:23 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:24 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284" returned: 0 in 0.408s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:24 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.info Sep 25 17:17:24 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:24 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.info" returned: 0 in 0.353s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:24 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.info is being set with open permissions: ugo+rw Sep 25 17:17:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:24 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.info Sep 25 17:17:24 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:24 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.info" returned: 0 in 0.347s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-f2ded46f-b304-4f5b-8ae5-bcdbf292fe6a req-be228905-541d-4807-8b0a-f921d6067be8 tempest-TestShelveInstance-775014126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.634s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-f2ded46f-b304-4f5b-8ae5-bcdbf292fe6a req-be228905-541d-4807-8b0a-f921d6067be8 tempest-TestShelveInstance-775014126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ca34d578-e1d7-4c04-8c98-7cf61488d0e4 tempest-VolumesDeleteCascade-1003652211 None] Create snapshot completed successfully Sep 25 17:17:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-f2ded46f-b304-4f5b-8ae5-bcdbf292fe6a req-be228905-541d-4807-8b0a-f921d6067be8 tempest-TestShelveInstance-775014126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-584dfe69-6942-4759-81cc-a6aa2bb45201', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2eb02fed-96f8-4b16-aa3c-cf95a89fb043', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:17:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-f2ded46f-b304-4f5b-8ae5-bcdbf292fe6a req-be228905-541d-4807-8b0a-f921d6067be8 tempest-TestShelveInstance-775014126 None] attachment_update completed successfully. Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Flow 'volume_create_manager' (61a42fef-9967-417c-a0f6-0bf196c78a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c60fca-2ffe-4f0c-9425-888dee0d55be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c60fca-2ffe-4f0c-9425-888dee0d55be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1208913643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941bd0f5506a4d24b00eaad3061ce15d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=65e1e90c-21a1-45b8-b79b-49c4b8534284,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:26Z,use_quota=True,user_id='45ea5c3a58b34731b32fbeea7f1284b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cc2c96-3113-44c2-b0f6-2b349a7cc712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cc2c96-3113-44c2-b0f6-2b349a7cc712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b7ab72-39b4-414c-b37d-bcc005feb867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b7ab72-39b4-414c-b37d-bcc005feb867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9', 'volume_name': 'volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9', 'volume_size': 1, 'snapshot_id': '65e1e90c-21a1-45b8-b79b-49c4b8534284'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a736f7fe-9b5a-47d6-89ab-fad129a27a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a736f7fe-9b5a-47d6-89ab-fad129a27a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5deeffcd-f0c8-459f-a3df-8a7a9fdaa6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:26 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Volume 058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9', 'volume_size': 1, 'snapshot_id': '65e1e90c-21a1-45b8-b79b-49c4b8534284'} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-65e1e90c-21a1-45b8-b79b-49c4b8534284-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-65e1e90c-21a1-45b8-b79b-49c4b8534284-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Creating volume 058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 from snapshot 65e1e90c-21a1-45b8-b79b-49c4b8534284 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] snapshot: 65e1e90c-21a1-45b8-b79b-49c4b8534284, volume: 058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[087eb175-8c99-4a1f-a4c6-d9873ca2c37a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:26 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 Sep 25 17:17:26 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:26 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05936742-192c-4f28-a7bd-06b5b14be956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1616ed70-83c6-4bdf-beab-2701995d73fe]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:27 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 Sep 25 17:17:27 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:27 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956" returned: 0 in 0.524s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:17:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:17:27 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:17:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:27 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 Sep 25 17:17:27 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=139,cinder:UPDATE=157,cinder:DELETE=16,cinder:INSERT=40 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=126,cinder:INSERT=49,cinder:UPDATE=165,cinder:DELETE=11 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Flow 'volume_create_manager' (84e6cc1c-2ca9-4a99-b072-917c6a339011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6454db-a779-4257-88f4-89254604118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6454db-a779-4257-88f4-89254604118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-156823395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663e4aca-2f80-4d04-b0b4-4ec775d5ebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71873c4d17bf422ba5c45af8c797903a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:36Z,use_quota=True,user_id='526d05a5f22a47d39637ba4ce39c445c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (368962f1-d74c-4015-befd-b85d898d722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (368962f1-d74c-4015-befd-b85d898d722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfed57-a44f-4b36-904d-e9865ed283a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cfed57-a44f-4b36-904d-e9865ed283a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663e4aca-2f80-4d04-b0b4-4ec775d5ebfb', 'volume_name': 'volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba47d7f-d75c-43fb-9b32-79295def0ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba47d7f-d75c-43fb-9b32-79295def0ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d2ce1f-74ac-4ae1-b046-2df1db5b1349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Volume 663e4aca-2f80-4d04-b0b4-4ec775d5ebfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb', 'volume_size': 1} Sep 25 17:17:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:37 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" returned: 0 in 9.948s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:37 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956, size 1024.00 MB, duration 9.95 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:17:37 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Converted 1024.00 MB image at 102.89 MB/s Sep 25 17:17:37 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 is being set with open permissions: ugo+rw Sep 25 17:17:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:37 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 Sep 25 17:17:37 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:37 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" returned: 0 in 0.421s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" released by "_copy_volume_from_snapshot" :: held 11.541s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-65e1e90c-21a1-45b8-b79b-49c4b8534284-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" released by "_create_volume_from_snapshot" :: held 11.665s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.687s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-156823395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663e4aca-2f80-4d04-b0b4-4ec775d5ebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71873c4d17bf422ba5c45af8c797903a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:36Z,use_quota=True,user_id='526d05a5f22a47d39637ba4ce39c445c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Creating volume 663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:38 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:38 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb 1073741824 Sep 25 17:17:38 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5deeffcd-f0c8-459f-a3df-8a7a9fdaa6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9', 'volume_size': 1, 'snapshot_id': '65e1e90c-21a1-45b8-b79b-49c4b8534284'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7826769-bc43-44e4-a060-bd2f979c3cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Volume volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 (058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9): created successfully Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7826769-bc43-44e4-a060-bd2f979c3cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Flow 'volume_create_manager' (61a42fef-9967-417c-a0f6-0bf196c78a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7cda82c2-4478-4bab-a550-991413b66f36 tempest-VolumesDeleteCascade-1003652211 None] Created volume successfully. Sep 25 17:17:38 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb 1073741824" returned: 0 in 0.849s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-05936742-192c-4f28-a7bd-06b5b14be956-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-05936742-192c-4f28-a7bd-06b5b14be956-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Performing cascade delete. {{(pid=87232) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 17:17:39 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb Sep 25 17:17:39 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-65e1e90c-21a1-45b8-b79b-49c4b8534284-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-65e1e90c-21a1-45b8-b79b-49c4b8534284-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-05936742-192c-4f28-a7bd-06b5b14be956" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-05936742-192c-4f28-a7bd-06b5b14be956" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-65e1e90c-21a1-45b8-b79b-49c4b8534284" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-65e1e90c-21a1-45b8-b79b-49c4b8534284" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Deleting offline snapshot 65e1e90c-21a1-45b8-b79b-49c4b8534284 of volume 05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] snapshot_file for this snap is: volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[00739529-0d19-4e2c-adf0-d4e044bbfab6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:39 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:39 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 Sep 25 17:17:39 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" returned: 0 in 0.471s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d2ce1f-74ac-4ae1-b046-2df1db5b1349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a31083-ab7d-4739-9be1-a4af9c8479f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Volume volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb (663e4aca-2f80-4d04-b0b4-4ec775d5ebfb): created successfully Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a31083-ab7d-4739-9be1-a4af9c8479f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Flow 'volume_create_manager' (84e6cc1c-2ca9-4a99-b072-917c6a339011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a0002af4-5959-4b3c-afff-97ca2a5b3478 tempest-TestStampPattern-376892887 None] Created volume successfully. Sep 25 17:17:39 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284" returned: 0 in 0.710s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05936742-192c-4f28-a7bd-06b5b14be956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:17:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f2fd5-fe2b-455d-bdad-f7c91b0627a3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:40 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 Sep 25 17:17:40 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:40 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956" returned: 0 in 0.802s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:40 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 Sep 25 17:17:40 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:41 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284" returned: 0 in 0.589s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:41 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284 Sep 25 17:17:41 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:41 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956.65e1e90c-21a1-45b8-b79b-49c4b8534284" returned: 0 in 0.492s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-65e1e90c-21a1-45b8-b79b-49c4b8534284" released by "_delete_snapshot" :: held 2.824s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-05936742-192c-4f28-a7bd-06b5b14be956" released by "delete_snapshot" :: held 2.870s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:42 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Created reservations ['c21b00dd-03cd-4abd-bad8-e2704ea76315', '2625200d-c823-49a8-8183-16353d9cacd8', '9cc5a70c-16fc-43f6-8cc1-9b5845bec25d', '4c182d53-49ee-4fea-ac5a-7a1090b8377a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Delete snapshot completed successfully. Sep 25 17:17:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-65e1e90c-21a1-45b8-b79b-49c4b8534284-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Snapshots deleted, issuing volume delete {{(pid=87232) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 17:17:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-05936742-192c-4f28-a7bd-06b5b14be956" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-05936742-192c-4f28-a7bd-06b5b14be956" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cec4d0-0d8b-48ee-9caf-e912f5be53e4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:42 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 Sep 25 17:17:42 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:43 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956" returned: 0 in 0.587s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:43 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956 Sep 25 17:17:43 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:43 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-05936742-192c-4f28-a7bd-06b5b14be956" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-05936742-192c-4f28-a7bd-06b5b14be956" released by "delete_volume" :: held 1.045s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Created reservations ['7de1fe31-cee8-41fb-976a-e9ee29eb049a', '35f6a96a-a08d-4a12-a5e2-374c46bbfaa6', '18cca366-8930-4d2d-b3b1-80e625fea70d', '20489817-28a0-424d-826c-8343436a7f1b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:43 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:17:43 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:43 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.304s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:43 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Deleted volume successfully. Sep 25 17:17:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6d4b60b1-bc74-4a5b-becf-9c3d8d955635 tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-05936742-192c-4f28-a7bd-06b5b14be956-delete_volume" released by "delete_volume" :: held 5.022s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "cinder-quobyte-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" acquired by "delete_volume" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:45 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e501c91-d4b4-49c8-9788-159aae4695a6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:45 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 Sep 25 17:17:45 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:45 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" returned: 0 in 0.604s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:45 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9 Sep 25 17:17:45 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:46 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-quobyte-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9" released by "delete_volume" :: held 1.062s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:46 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Created reservations ['2959bc5d-db7c-43c7-84ad-fe1fa87955b0', '27163680-36ee-4c10-9955-118e0693691f', '8206b022-3b7a-4782-b631-a14dd1aac859', 'fdd3acb0-52e5-4bba-a01e-0b51a7ccfda5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:46 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:17:46 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:47 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.612s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:47 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Deleted volume successfully. Sep 25 17:17:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4ae3f9d-d022-4cff-b3d7-afdff945711f tempest-VolumesDeleteCascade-1003652211 None] Lock "cinder-058e2b0c-ee8d-48f3-9a1d-41a76a2c30b9-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Flow 'volume_create_manager' (9d403cf4-6ac8-4eb4-97cb-ae86add07169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1624fe8e-8288-402d-8c3b-3019d56f208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1624fe8e-8288-402d-8c3b-3019d56f208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1105849059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a08836-d4fb-4952-83ac-9a160b25013d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044cad7a08cf4f1290b2420ddb1a58de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:55Z,use_quota=True,user_id='a0cdd0c72a7c4126ace2bc0858ed1243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42578411-a1ab-49d4-8a4c-7d8a992f8166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42578411-a1ab-49d4-8a4c-7d8a992f8166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306ed338-ce9c-41df-a53b-df3a6247aa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306ed338-ce9c-41df-a53b-df3a6247aa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a08836-d4fb-4952-83ac-9a160b25013d', 'volume_name': 'volume-c0a08836-d4fb-4952-83ac-9a160b25013d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68985fd-33ef-47f7-ba11-6eb4317fbe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68985fd-33ef-47f7-ba11-6eb4317fbe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54aafeb-6238-47a2-8f70-0a98fecb2679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Volume c0a08836-d4fb-4952-83ac-9a160b25013d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a08836-d4fb-4952-83ac-9a160b25013d', 'volume_size': 1} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1105849059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a08836-d4fb-4952-83ac-9a160b25013d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044cad7a08cf4f1290b2420ddb1a58de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:17:55Z,use_quota=True,user_id='a0cdd0c72a7c4126ace2bc0858ed1243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Creating volume c0a08836-d4fb-4952-83ac-9a160b25013d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:17:55 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:55 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d 1073741824 Sep 25 17:17:55 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:55 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d 1073741824" returned: 0 in 0.523s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:55 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d Sep 25 17:17:55 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:56 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:17:56 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:56 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d" returned: 0 in 0.382s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54aafeb-6238-47a2-8f70-0a98fecb2679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a08836-d4fb-4952-83ac-9a160b25013d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4307c66c-093f-4d5f-b414-2d9c2b731b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:17:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Volume volume-c0a08836-d4fb-4952-83ac-9a160b25013d (c0a08836-d4fb-4952-83ac-9a160b25013d): created successfully Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4307c66c-093f-4d5f-b414-2d9c2b731b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Flow 'volume_create_manager' (9d403cf4-6ac8-4eb4-97cb-ae86add07169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:17:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7dc2c2fb-5abe-454d-9383-f0917de7bc78 tempest-VolumesTransfersV357Test-1892668383 None] Created volume successfully. Sep 25 17:17:56 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.380s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:17:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:17:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cb024a2a-d654-4a86-a777-164f731f0cf4 tempest-VolumesTransfersV357Test-1158780619 None] Transfer volume completed successfully. Sep 25 17:17:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Acquiring lock "cinder-c0a08836-d4fb-4952-83ac-9a160b25013d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Lock "cinder-c0a08836-d4fb-4952-83ac-9a160b25013d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Acquiring lock "cinder-quobyte-c0a08836-d4fb-4952-83ac-9a160b25013d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:17:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Lock "cinder-quobyte-c0a08836-d4fb-4952-83ac-9a160b25013d" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:17:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce05c4c-677a-4125-8400-7918fa56522b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:17:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:59 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d Sep 25 17:17:59 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:59 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d" returned: 0 in 0.398s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:59 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d Sep 25 17:17:59 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:17:59 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c0a08836-d4fb-4952-83ac-9a160b25013d" returned: 0 in 0.297s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Lock "cinder-quobyte-c0a08836-d4fb-4952-83ac-9a160b25013d" released by "delete_volume" :: held 0.737s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Created reservations ['1d58f50d-69e0-4979-9d5f-dcaf6c4d6652', '214c6ff5-08b2-45ba-a9de-25c1fddbd40b', 'f7ab8f48-cb57-4d33-b6eb-cea6bf767bc7', 'c497666d-be78-4210-aa87-a6fb9e39c455'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:17:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:17:59 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:17:59 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:00 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Deleted volume successfully. Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-af37c939-4b0f-413b-a697-d0dfe8cec151 tempest-VolumesTransfersV357Test-156900622 None] Lock "cinder-c0a08836-d4fb-4952-83ac-9a160b25013d-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Flow 'volume_create_manager' (d2e410e3-0a1e-47ab-9ea5-539c9cb955a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6fec99-4ff6-4866-b6e4-cf28ba518319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6fec99-4ff6-4866-b6e4-cf28ba518319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-491515932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4360d8-8840-440c-b046-7e66f8b286fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044cad7a08cf4f1290b2420ddb1a58de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:01Z,use_quota=True,user_id='a0cdd0c72a7c4126ace2bc0858ed1243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a966fdcd-76c0-49c7-8d60-f177ee43a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a966fdcd-76c0-49c7-8d60-f177ee43a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6478a2-3721-47aa-a601-1a5e16325884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6478a2-3721-47aa-a601-1a5e16325884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4360d8-8840-440c-b046-7e66f8b286fb', 'volume_name': 'volume-1d4360d8-8840-440c-b046-7e66f8b286fb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f717d9-8b06-478a-87e6-3ed8d6734030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f717d9-8b06-478a-87e6-3ed8d6734030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc93c5f-8fb6-4240-92e1-24f3256e698e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Volume 1d4360d8-8840-440c-b046-7e66f8b286fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4360d8-8840-440c-b046-7e66f8b286fb', 'volume_size': 1} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-491515932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4360d8-8840-440c-b046-7e66f8b286fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044cad7a08cf4f1290b2420ddb1a58de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:01Z,use_quota=True,user_id='a0cdd0c72a7c4126ace2bc0858ed1243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Creating volume 1d4360d8-8840-440c-b046-7e66f8b286fb {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:18:00 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:18:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:00 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb 1073741824 Sep 25 17:18:00 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:01 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb 1073741824" returned: 0 in 0.505s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:01 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb Sep 25 17:18:01 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:01 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:18:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc93c5f-8fb6-4240-92e1-24f3256e698e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4360d8-8840-440c-b046-7e66f8b286fb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050c4a4f-2f15-4885-b21e-58a303bd5d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Volume volume-1d4360d8-8840-440c-b046-7e66f8b286fb (1d4360d8-8840-440c-b046-7e66f8b286fb): created successfully Sep 25 17:18:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050c4a4f-2f15-4885-b21e-58a303bd5d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Flow 'volume_create_manager' (d2e410e3-0a1e-47ab-9ea5-539c9cb955a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-083623d9-5b18-426a-aa60-e939cfd04e16 tempest-VolumesTransfersV357Test-1892668383 None] Created volume successfully. Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Acquiring lock "cinder-1d4360d8-8840-440c-b046-7e66f8b286fb-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Lock "cinder-1d4360d8-8840-440c-b046-7e66f8b286fb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Acquiring lock "cinder-quobyte-1d4360d8-8840-440c-b046-7e66f8b286fb" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Lock "cinder-quobyte-1d4360d8-8840-440c-b046-7e66f8b286fb" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd57cb76-100c-4eeb-bc7a-904d234758c0]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:03 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb Sep 25 17:18:03 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:03 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb" returned: 0 in 0.405s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:03 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb Sep 25 17:18:03 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:03 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d4360d8-8840-440c-b046-7e66f8b286fb" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Lock "cinder-quobyte-1d4360d8-8840-440c-b046-7e66f8b286fb" released by "delete_volume" :: held 0.728s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Created reservations ['414e9bc0-a4c8-46de-a9f3-2a233594f970', 'a30f437e-0ec9-4dfc-add2-ad192b05c65d', '01087197-6781-4a96-bc3a-d913bec29699', 'a752dd16-a7d8-4709-9c20-9b57b9dec67f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:04 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:18:04 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:04 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.287s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:04 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Deleted volume successfully. Sep 25 17:18:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-69828a92-11b9-4dfc-82e0-adc08ffe30be tempest-VolumesTransfersV357Test-156900622 None] Lock "cinder-1d4360d8-8840-440c-b046-7e66f8b286fb-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:13 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=29,cinder:INSERT=14,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:18:14 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=55,cinder:SELECT=38,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:18:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-1631dbf9-29e3-45fa-a418-5d2265053461 req-8befb9ea-b9c7-4f4b-9890-5e9223f8274c tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-1631dbf9-29e3-45fa-a418-5d2265053461 req-8befb9ea-b9c7-4f4b-9890-5e9223f8274c tempest-TestStampPattern-376892887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-1631dbf9-29e3-45fa-a418-5d2265053461 req-8befb9ea-b9c7-4f4b-9890-5e9223f8274c tempest-TestStampPattern-376892887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-1631dbf9-29e3-45fa-a418-5d2265053461 req-8befb9ea-b9c7-4f4b-9890-5e9223f8274c tempest-TestStampPattern-376892887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '678207c6-0e04-4ea0-8bbb-7daef4f016dc', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:18:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-1631dbf9-29e3-45fa-a418-5d2265053461 req-8befb9ea-b9c7-4f4b-9890-5e9223f8274c tempest-TestStampPattern-376892887 None] attachment_update completed successfully. Sep 25 17:18:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-b07e4d0c-c4fd-4934-af33-05db0c9171c5 req-a9a97ad9-f821-41fb-bc2f-8e8d42d5b129 tempest-TestStampPattern-376892887 None] Terminate volume connection completed successfully. Sep 25 17:18:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-b07e4d0c-c4fd-4934-af33-05db0c9171c5 req-a9a97ad9-f821-41fb-bc2f-8e8d42d5b129 tempest-TestStampPattern-376892887 None] Deleting attachment 678207c6-0e04-4ea0-8bbb-7daef4f016dc. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (e0d27ca8-152d-4224-836e-4024dcd4fecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44efdfee-690a-4f59-a6c2-0bab55bae122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44efdfee-690a-4f59-a6c2-0bab55bae122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-240964770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81da5424-3afa-4e10-aa7a-055e21498369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5f6a1db1224d1ab41c444b6923ba8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:23Z,use_quota=True,user_id='666edb824f9148618404ab704c0d37f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568d9779-4169-4316-a3ad-c38775a6f19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568d9779-4169-4316-a3ad-c38775a6f19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b9744c-bb7e-4fb0-895a-ae455b408940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b9744c-bb7e-4fb0-895a-ae455b408940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81da5424-3afa-4e10-aa7a-055e21498369', 'volume_name': 'volume-81da5424-3afa-4e10-aa7a-055e21498369', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab78f77-f5ac-42f2-a2e5-b429bca84912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab78f77-f5ac-42f2-a2e5-b429bca84912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07d0b40-3c5a-4225-b6cb-9e9911b8ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Volume 81da5424-3afa-4e10-aa7a-055e21498369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81da5424-3afa-4e10-aa7a-055e21498369', 'volume_size': 1} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-240964770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81da5424-3afa-4e10-aa7a-055e21498369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5f6a1db1224d1ab41c444b6923ba8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:23Z,use_quota=True,user_id='666edb824f9148618404ab704c0d37f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Creating volume 81da5424-3afa-4e10-aa7a-055e21498369 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:18:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:18:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:23 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 1073741824 Sep 25 17:18:23 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:24 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 1073741824" returned: 0 in 0.739s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:24 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 Sep 25 17:18:24 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-fab1f6f3-268d-4c0d-a373-94c1e9efe5a4 tempest-TestShelveInstance-775014126 None] Terminate volume connection completed successfully. Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-fab1f6f3-268d-4c0d-a373-94c1e9efe5a4 tempest-TestShelveInstance-775014126 None] Deleting attachment 2eb02fed-96f8-4b16-aa3c-cf95a89fb043. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:18:24 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.417s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d07d0b40-3c5a-4225-b6cb-9e9911b8ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81da5424-3afa-4e10-aa7a-055e21498369', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e54bd22-4875-471f-a5c0-29b290d00ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Acquiring lock "cinder-584dfe69-6942-4759-81cc-a6aa2bb45201-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Creating offline snapshot 3dec584f-95b1-47a6-b55d-5d362e61efa0 of volume 663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:18:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Volume volume-81da5424-3afa-4e10-aa7a-055e21498369 (81da5424-3afa-4e10-aa7a-055e21498369): created successfully Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e54bd22-4875-471f-a5c0-29b290d00ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (e0d27ca8-152d-4224-836e-4024dcd4fecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33c5256-2183-40de-b204-b6e7dd273af8]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Lock "cinder-584dfe69-6942-4759-81cc-a6aa2bb45201-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0d4cbd8a-ea1e-4377-ad53-63443b383be4 tempest-VolumesSnapshotTestJSON-90940879 None] Created volume successfully. Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Acquiring lock "cinder-quobyte-584dfe69-6942-4759-81cc-a6aa2bb45201" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Lock "cinder-quobyte-584dfe69-6942-4759-81cc-a6aa2bb45201" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2412e-61bd-4fac-9d9e-00eea07a2e06]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:25 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb Sep 25 17:18:25 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:25 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 Sep 25 17:18:25 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:25 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" returned: 0 in 0.527s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:25 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 1G Sep 25 17:18:25 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:25 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201" returned: 0 in 0.591s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:25 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201 Sep 25 17:18:25 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:25 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-584dfe69-6942-4759-81cc-a6aa2bb45201" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Lock "cinder-quobyte-584dfe69-6942-4759-81cc-a6aa2bb45201" released by "delete_volume" :: held 1.037s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:26 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 1G" returned: 0 in 0.694s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG cinder.quota [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Created reservations ['9bcfb489-3b16-4dc3-868a-733e3f0217d0', '432ec660-f2e9-4730-b0af-e6b8a2093b25', '9aaa9262-de2e-4896-9c40-b1523c9c908f', '45eaec3e-4fbd-498b-854e-58b09649765a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:26 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 Sep 25 17:18:26 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:26 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:18:26 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:26 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:26 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0" returned: 0 in 0.486s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:26 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 is being set with open permissions: ugo+rw Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG cinder.manager [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Deleted volume successfully. Sep 25 17:18:26 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 Sep 25 17:18:26 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [req-4e238108-c641-4d96-b3d6-b3c5fe43c9ff req-f1c40fd5-5b1c-4c48-8329-7920e6bf8b85 tempest-TestShelveInstance-775014126 None] Lock "cinder-584dfe69-6942-4759-81cc-a6aa2bb45201-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:26 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0" returned: 0 in 0.302s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:26 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.info Sep 25 17:18:26 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:27 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.info" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:27 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.info is being set with open permissions: ugo+rw Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:27 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.info Sep 25 17:18:27 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:27 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.info" returned: 0 in 0.277s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.422s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Creating offline snapshot 697932d5-c9e6-4a34-b449-226b80b76591 of volume 81da5424-3afa-4e10-aa7a-055e21498369 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:18:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-666486a2-db47-46ec-8438-f08e6a2ab11a tempest-TestStampPattern-376892887 None] Create snapshot completed successfully Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca2da08-81c3-45eb-8bc5-bab8d13786eb]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:27 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 Sep 25 17:18:27 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:27 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369" returned: 0 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:27 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 1G Sep 25 17:18:27 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:28 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 1G" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81da5424-3afa-4e10-aa7a-055e21498369 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:28 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81da5424-3afa-4e10-aa7a-055e21498369 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 Sep 25 17:18:28 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:28 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81da5424-3afa-4e10-aa7a-055e21498369 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:28 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 is being set with open permissions: ugo+rw Sep 25 17:18:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:28 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 Sep 25 17:18:28 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:29 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:29 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.info Sep 25 17:18:29 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:29 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.info" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:29 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.info is being set with open permissions: ugo+rw Sep 25 17:18:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:29 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.info Sep 25 17:18:29 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:29 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.info" returned: 0 in 0.323s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2c097a43-604f-493e-bf27-038511084385 tempest-VolumesSnapshotTestJSON-90940879 None] Create snapshot completed successfully Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-697932d5-c9e6-4a34-b449-226b80b76591-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-697932d5-c9e6-4a34-b449-226b80b76591-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-81da5424-3afa-4e10-aa7a-055e21498369" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-81da5424-3afa-4e10-aa7a-055e21498369" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-697932d5-c9e6-4a34-b449-226b80b76591" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-697932d5-c9e6-4a34-b449-226b80b76591" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Deleting offline snapshot 697932d5-c9e6-4a34-b449-226b80b76591 of volume 81da5424-3afa-4e10-aa7a-055e21498369 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] snapshot_file for this snap is: volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe817aa-63e7-4a5b-b2e6-61d8ec525141]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:30 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 Sep 25 17:18:30 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:31 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591" returned: 0 in 0.405s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81da5424-3afa-4e10-aa7a-055e21498369(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:18:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7a76c7-dfd9-445b-a526-f9bf385bad6b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:31 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 Sep 25 17:18:31 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:31 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369" returned: 0 in 0.483s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:31 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 Sep 25 17:18:31 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:32 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591" returned: 0 in 0.434s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:32 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591 Sep 25 17:18:32 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:32 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369.697932d5-c9e6-4a34-b449-226b80b76591" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-697932d5-c9e6-4a34-b449-226b80b76591" released by "_delete_snapshot" :: held 1.785s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-81da5424-3afa-4e10-aa7a-055e21498369" released by "delete_snapshot" :: held 1.811s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:32 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Created reservations ['9fb24079-acb0-402e-be6c-b16371a68cc0', '10d089af-2bdd-4d1d-b3cc-5a0e054e057f', '4cedfe61-25d0-46ff-9d3c-27b3b6d33de6', 'ea01bbf7-b777-42b7-81f9-6c420a20e376'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:18:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Delete snapshot completed successfully. Sep 25 17:18:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e03aa31-426a-4004-86ef-914631421bd6 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-697932d5-c9e6-4a34-b449-226b80b76591-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (26b1718c-73b2-4af9-be59-25128281f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f765ec5-9cdf-409c-8c06-863db31c234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f765ec5-9cdf-409c-8c06-863db31c234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1974733792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b76c9ca-74ea-4dab-92be-73dfe6489d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5f6a1db1224d1ab41c444b6923ba8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:33Z,use_quota=True,user_id='666edb824f9148618404ab704c0d37f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18583acc-99cc-4ee4-be99-1228677c3345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18583acc-99cc-4ee4-be99-1228677c3345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48414925-dc5f-44ed-89e1-309e0676d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48414925-dc5f-44ed-89e1-309e0676d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b76c9ca-74ea-4dab-92be-73dfe6489d0f', 'volume_name': 'volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67198a33-2474-4e01-8d73-3f68665c5a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67198a33-2474-4e01-8d73-3f68665c5a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a6ddb4-1b18-4233-afd6-5e616624775f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Volume 1b76c9ca-74ea-4dab-92be-73dfe6489d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f', 'volume_size': 1} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1974733792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b76c9ca-74ea-4dab-92be-73dfe6489d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5f6a1db1224d1ab41c444b6923ba8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:33Z,use_quota=True,user_id='666edb824f9148618404ab704c0d37f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Creating volume 1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:18:33 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:18:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:33 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f 1073741824 Sep 25 17:18:33 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:34 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f 1073741824" returned: 0 in 0.582s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:34 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f Sep 25 17:18:34 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:34 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:18:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a6ddb4-1b18-4233-afd6-5e616624775f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb972cfc-abf1-41e0-b282-b2620a3b444f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Volume volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f (1b76c9ca-74ea-4dab-92be-73dfe6489d0f): created successfully Sep 25 17:18:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb972cfc-abf1-41e0-b282-b2620a3b444f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (26b1718c-73b2-4af9-be59-25128281f732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-46162e53-ac59-43ff-b360-9080ccdcd5f9 tempest-VolumesSnapshotTestJSON-90940879 None] Created volume successfully. Sep 25 17:18:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Creating offline snapshot 3b32ee83-defe-4419-8f7e-3f14a098e838 of volume 1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:18:35 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a424cab-4c76-4bb1-9372-b618019946bd]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:36 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f Sep 25 17:18:36 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:36 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" returned: 0 in 0.479s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:36 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 1G Sep 25 17:18:36 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Flow 'volume_create_manager' (78e6882a-004d-4fc5-a86f-de3efce84839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1334d2-d7ec-4370-8ac4-cd50cc39abc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1334d2-d7ec-4370-8ac4-cd50cc39abc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1234896374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62deea70-53f4-49f9-89d8-20adcfbf426a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71873c4d17bf422ba5c45af8c797903a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3dec584f-95b1-47a6-b55d-5d362e61efa0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:37Z,use_quota=True,user_id='526d05a5f22a47d39637ba4ce39c445c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3a0fed-0651-42dc-813a-5b8e9cfc1868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3a0fed-0651-42dc-813a-5b8e9cfc1868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7629097e-a1f4-4a67-aa5f-2e48fe9f0f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7629097e-a1f4-4a67-aa5f-2e48fe9f0f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62deea70-53f4-49f9-89d8-20adcfbf426a', 'volume_name': 'volume-62deea70-53f4-49f9-89d8-20adcfbf426a', 'volume_size': 1, 'snapshot_id': '3dec584f-95b1-47a6-b55d-5d362e61efa0'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e28003a-5cb7-420c-9f17-c607f90e461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e28003a-5cb7-420c-9f17-c607f90e461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579336b5-12dc-4df8-8441-b96a99f4dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Volume 62deea70-53f4-49f9-89d8-20adcfbf426a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62deea70-53f4-49f9-89d8-20adcfbf426a', 'volume_size': 1, 'snapshot_id': '3dec584f-95b1-47a6-b55d-5d362e61efa0'} Sep 25 17:18:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:37 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 1G" returned: 0 in 0.697s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:37 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 Sep 25 17:18:37 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:37 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:37 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 is being set with open permissions: ugo+rw Sep 25 17:18:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:37 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 Sep 25 17:18:37 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:37 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:37 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.info Sep 25 17:18:37 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:38 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.info" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:38 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.info is being set with open permissions: ugo+rw Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:38 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.info Sep 25 17:18:38 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:38 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.info" returned: 0 in 0.338s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.751s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.655s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Acquiring lock "cinder-quobyte-3dec584f-95b1-47a6-b55d-5d362e61efa0-62deea70-53f4-49f9-89d8-20adcfbf426a" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-3dec584f-95b1-47a6-b55d-5d362e61efa0-62deea70-53f4-49f9-89d8-20adcfbf426a" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Creating volume 62deea70-53f4-49f9-89d8-20adcfbf426a from snapshot 3dec584f-95b1-47a6-b55d-5d362e61efa0 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Acquiring lock "cinder-quobyte-62deea70-53f4-49f9-89d8-20adcfbf426a" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1937bef3-3382-45f4-9faa-6379401941cd tempest-VolumesSnapshotTestJSON-90940879 None] Create snapshot completed successfully Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-62deea70-53f4-49f9-89d8-20adcfbf426a" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] snapshot: 3dec584f-95b1-47a6-b55d-5d362e61efa0, volume: 62deea70-53f4-49f9-89d8-20adcfbf426a, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[76496877-b2fa-4a7f-a456-36b563f57f66]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:38 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 Sep 25 17:18:38 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:39 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0" returned: 0 in 0.605s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:18:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[277e1b39-3f89-4df2-a1d8-f7c81c0268c3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:39 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb Sep 25 17:18:39 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (55dcac08-13ba-4523-ab74-2f3f01b41f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04452fa-603d-48ab-b542-11eb273c046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04452fa-603d-48ab-b542-11eb273c046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-203630006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde37b14-c28f-4419-b9be-d31011f99399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5f6a1db1224d1ab41c444b6923ba8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3b32ee83-defe-4419-8f7e-3f14a098e838,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:40Z,use_quota=True,user_id='666edb824f9148618404ab704c0d37f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:40 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d8f07d-714b-4546-a9e4-9089b1cbf32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d8f07d-714b-4546-a9e4-9089b1cbf32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ebac77-a12d-4ad4-a1be-5e29341f5448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ebac77-a12d-4ad4-a1be-5e29341f5448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cde37b14-c28f-4419-b9be-d31011f99399', 'volume_name': 'volume-cde37b14-c28f-4419-b9be-d31011f99399', 'volume_size': 2, 'snapshot_id': '3b32ee83-defe-4419-8f7e-3f14a098e838'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdde9ea-7a3e-4b45-9e6e-8d815b5c34ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdde9ea-7a3e-4b45-9e6e-8d815b5c34ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e931060c-8afd-4b16-acd9-22b55beb66d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Volume cde37b14-c28f-4419-b9be-d31011f99399: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cde37b14-c28f-4419-b9be-d31011f99399', 'volume_size': 2, 'snapshot_id': '3b32ee83-defe-4419-8f7e-3f14a098e838'} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" returned: 0 in 0.876s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:40 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a Sep 25 17:18:40 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:50 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=49,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:18:50 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=38,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:18:50 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a" returned: 0 in 10.279s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:50 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb, size 1024.00 MB, duration 10.28 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:18:50 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Converted 1024.00 MB image at 99.61 MB/s Sep 25 17:18:50 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a is being set with open permissions: ugo+rw Sep 25 17:18:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:50 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a Sep 25 17:18:50 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:50 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-62deea70-53f4-49f9-89d8-20adcfbf426a" released by "_copy_volume_from_snapshot" :: held 12.292s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-3dec584f-95b1-47a6-b55d-5d362e61efa0-62deea70-53f4-49f9-89d8-20adcfbf426a" released by "_create_volume_from_snapshot" :: held 12.430s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.471s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.734s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-3b32ee83-defe-4419-8f7e-3f14a098e838-cde37b14-c28f-4419-b9be-d31011f99399" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-3b32ee83-defe-4419-8f7e-3f14a098e838-cde37b14-c28f-4419-b9be-d31011f99399" acquired by "_create_volume_from_snapshot" :: waited 0.068s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Creating volume cde37b14-c28f-4419-b9be-d31011f99399 from snapshot 3b32ee83-defe-4419-8f7e-3f14a098e838 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-cde37b14-c28f-4419-b9be-d31011f99399" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579336b5-12dc-4df8-8441-b96a99f4dde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62deea70-53f4-49f9-89d8-20adcfbf426a', 'volume_size': 1, 'snapshot_id': '3dec584f-95b1-47a6-b55d-5d362e61efa0'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9e9da8-2fd1-4374-9e4d-8a071422f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:51 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Volume volume-62deea70-53f4-49f9-89d8-20adcfbf426a (62deea70-53f4-49f9-89d8-20adcfbf426a): created successfully Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9e9da8-2fd1-4374-9e4d-8a071422f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Flow 'volume_create_manager' (78e6882a-004d-4fc5-a86f-de3efce84839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-cde37b14-c28f-4419-b9be-d31011f99399" acquired by "_copy_volume_from_snapshot" :: waited 0.069s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] snapshot: 3b32ee83-defe-4419-8f7e-3f14a098e838, volume: cde37b14-c28f-4419-b9be-d31011f99399, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0b8c5d1b-8bb1-40a2-a753-bf02b7063acd tempest-TestStampPattern-376892887 None] Created volume successfully. Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c693e2e-9ae1-4294-9a68-a59a1a053f61]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:51 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 Sep 25 17:18:51 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:51 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838" returned: 0 in 0.531s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fd1bc1-0049-4ba9-a3db-76ffda76d864]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:52 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f Sep 25 17:18:52 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:52 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" returned: 0 in 0.513s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:18:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:18:52 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:18:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:52 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 Sep 25 17:18:52 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:55 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:18:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Flow 'volume_create_manager' (ca739147-c8dd-4803-89a9-8b9b912287ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:18:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a135ac2-76d3-48c0-ade9-890b07738eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a135ac2-76d3-48c0-ade9-890b07738eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7e0fc8-78f7-4f9b-9226-f8f43dca110a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e2c0332f84414fa6dacd867a21b29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:55Z,use_quota=True,user_id='5ab68e8c059c44e8b3c4956aadb1d02d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b46663f9-def2-4963-a62e-6e3c8bd8f71f),volume_type_id=b46663f9-def2-4963-a62e-6e3c8bd8f71f)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b01240b-d8d7-4d86-8a7b-eb9bba76860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b01240b-d8d7-4d86-8a7b-eb9bba76860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd74e88-793c-4ed4-8282-94e70c170bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:55 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:56 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:18:56 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd74e88-793c-4ed4-8282-94e70c170bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d7e0fc8-78f7-4f9b-9226-f8f43dca110a', 'volume_name': 'volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a', 'volume_size': 1, 'image_id': 'da837564-8fa1-406b-bf22-f3687f2806e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da837564-8fa1-406b-bf22-f3687f2806e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b9aecb2a31216b5366ecaca85bd7320e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38e2c0332f84414fa6dacd867a21b29b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e910e2452c3da385a27fe0c9b7b8b153017404fa694e26b6182002f1d5a6e0d55d63d74c4ac5ed9e34a8b49af766224da97e1d9eab3a89c8f50dba3246539e9', 'id': 'da837564-8fa1-406b-bf22-f3687f2806e1', 'created_at': datetime.datetime(2026, 9, 25, 15, 18, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 18, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da837564-8fa1-406b-bf22-f3687f2806e1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f320c21f-043d-44da-809a-61fbf25a4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f320c21f-043d-44da-809a-61fbf25a4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed397352-2399-4797-a2ca-ff364bf93dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:18:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Volume 5d7e0fc8-78f7-4f9b-9226-f8f43dca110a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a', 'volume_size': 1, 'image_id': 'da837564-8fa1-406b-bf22-f3687f2806e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da837564-8fa1-406b-bf22-f3687f2806e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b9aecb2a31216b5366ecaca85bd7320e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38e2c0332f84414fa6dacd867a21b29b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e910e2452c3da385a27fe0c9b7b8b153017404fa694e26b6182002f1d5a6e0d55d63d74c4ac5ed9e34a8b49af766224da97e1d9eab3a89c8f50dba3246539e9', 'id': 'da837564-8fa1-406b-bf22-f3687f2806e1', 'created_at': datetime.datetime(2026, 9, 25, 15, 18, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 18, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da837564-8fa1-406b-bf22-f3687f2806e1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Trying to clone 5d7e0fc8-78f7-4f9b-9226-f8f43dca110a from image da837564-8fa1-406b-bf22-f3687f2806e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/da837564-8fa1-406b-bf22-f3687f2806e1', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:18:56 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.531s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:18:56 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:18:56 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Image download 0.00 MB at 0.00 MB/s Sep 25 17:18:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[31493a02-253c-4525-8f8e-5f84be4f9aaf]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:57 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD Sep 25 17:18:57 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:58 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD" returned: 0 in 1.063s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:58 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD Sep 25 17:18:58 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:18:59 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 25 17:18:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD" returned: 1 in 1.048s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:18:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:18:59 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Temporary image da837564-8fa1-406b-bf22-f3687f2806e1 is fetched for user 5ab68e8c059c44e8b3c4956aadb1d02d. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:18:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[657821b3-d6f5-4a68-b7ad-f5dd69c2c2f3]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:18:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:18:59 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD Sep 25 17:18:59 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:00 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD" returned: 0 in 0.887s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:00 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD Sep 25 17:19:00 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:00 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD" returned: 1 in 0.587s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:02 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399" returned: 0 in 9.900s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:19:02 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Converted 1024.00 MB image at 103.43 MB/s Sep 25 17:19:02 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 is being set with open permissions: ugo+rw Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:02 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 Sep 25 17:19:02 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:02 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399" returned: 0 in 0.264s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-cde37b14-c28f-4419-b9be-d31011f99399" released by "_copy_volume_from_snapshot" :: held 11.361s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-3b32ee83-defe-4419-8f7e-3f14a098e838-cde37b14-c28f-4419-b9be-d31011f99399" released by "_create_volume_from_snapshot" :: held 11.491s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.562s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7e0fc8-78f7-4f9b-9226-f8f43dca110a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38e2c0332f84414fa6dacd867a21b29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:18:55Z,use_quota=True,user_id='5ab68e8c059c44e8b3c4956aadb1d02d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b46663f9-def2-4963-a62e-6e3c8bd8f71f),volume_type_id=b46663f9-def2-4963-a62e-6e3c8bd8f71f)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Creating volume 5d7e0fc8-78f7-4f9b-9226-f8f43dca110a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:02 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:02 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a 1073741824 Sep 25 17:19:02 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e931060c-8afd-4b16-acd9-22b55beb66d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde37b14-c28f-4419-b9be-d31011f99399', 'volume_size': 2, 'snapshot_id': '3b32ee83-defe-4419-8f7e-3f14a098e838'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b54c8c-52e5-4e59-98c7-c8e913e0b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Volume volume-cde37b14-c28f-4419-b9be-d31011f99399 (cde37b14-c28f-4419-b9be-d31011f99399): created successfully Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b54c8c-52e5-4e59-98c7-c8e913e0b57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (55dcac08-13ba-4523-ab74-2f3f01b41f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-756f8f48-3b3e-421c-ae83-c10d68f3ed30 tempest-VolumesSnapshotTestJSON-90940879 None] Created volume successfully. Sep 25 17:19:03 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a 1073741824" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-cde37b14-c28f-4419-b9be-d31011f99399-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-cde37b14-c28f-4419-b9be-d31011f99399-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:03 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a Sep 25 17:19:03 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-cde37b14-c28f-4419-b9be-d31011f99399" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-cde37b14-c28f-4419-b9be-d31011f99399" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[529676a9-0e6a-416a-b2ad-1f3d1f40ce5f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:03 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 Sep 25 17:19:03 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:03 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a" returned: 0 in 0.335s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Attempting download of da837564-8fa1-406b-bf22-f3687f2806e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/da837564-8fa1-406b-bf22-f3687f2806e1', 'metadata': {}}])) to volume 5d7e0fc8-78f7-4f9b-9226-f8f43dca110a. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcc6d69-4ded-495a-846b-698954d8e9aa]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da837564-8fa1-406b-bf22-f3687f2806e1_2fks8soq {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:03 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da837564-8fa1-406b-bf22-f3687f2806e1_2fks8soq Sep 25 17:19:03 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:03 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:03 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399 Sep 25 17:19:03 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:04 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da837564-8fa1-406b-bf22-f3687f2806e1_2fks8soq" returned: 0 in 0.377s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da837564-8fa1-406b-bf22-f3687f2806e1_2fks8soq {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:04 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cde37b14-c28f-4419-b9be-d31011f99399" returned: 0 in 0.295s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-cde37b14-c28f-4419-b9be-d31011f99399" released by "delete_volume" :: held 0.783s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:04 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da837564-8fa1-406b-bf22-f3687f2806e1_2fks8soq Sep 25 17:19:04 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Created reservations ['5a98955b-f7dc-4975-a3ed-c7f3ee59804c', 'b005aead-3aca-4082-b7d1-e975a1ca1575', '69ec818a-cb4a-4488-9578-7732ee4f47d4', '2172f8d1-b7d7-4aad-bcbc-79bd50c45075'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:04 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:04 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:04 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da837564-8fa1-406b-bf22-f3687f2806e1_2fks8soq" returned: 1 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da837564-8fa1-406b-bf22-f3687f2806e1_2fks8soq' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2425f709-8cf5-477b-ba40-691537f33f74]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-3b32ee83-defe-4419-8f7e-3f14a098e838-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-3b32ee83-defe-4419-8f7e-3f14a098e838-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-3b32ee83-defe-4419-8f7e-3f14a098e838" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-3b32ee83-defe-4419-8f7e-3f14a098e838" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Deleting offline snapshot 3b32ee83-defe-4419-8f7e-3f14a098e838 of volume 1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:19:04 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] snapshot_file for this snap is: volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.328s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Deleted volume successfully. Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d12792-1ce8-4071-8194-8fff7b19db5a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:04 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD Sep 25 17:19:04 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e1a696b3-15e6-4e58-9102-2a3933504270 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-cde37b14-c28f-4419-b9be-d31011f99399-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:04 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 Sep 25 17:19:04 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:04 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:04 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD Sep 25 17:19:04 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:05 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838" returned: 0 in 0.403s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3383ec1-f826-4048-86bd-e45f71473110]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:05 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f Sep 25 17:19:05 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:05 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] da837564-8fa1-406b-bf22-f3687f2806e1 was raw, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:05 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a Sep 25 17:19:05 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:05 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" returned: 0 in 0.591s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:05 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 Sep 25 17:19:05 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:05 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a" returned: 0 in 0.573s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_da837564-8fa1-406b-bf22-f3687f2806e1_sv2783s9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:19:05 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 17:19:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:05 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a 1G Sep 25 17:19:05 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:06 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838" returned: 0 in 0.361s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:06 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838 Sep 25 17:19:06 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:06 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a 1G" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Downloaded image da837564-8fa1-406b-bf22-f3687f2806e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/da837564-8fa1-406b-bf22-f3687f2806e1', 'metadata': {}}])) to volume 5d7e0fc8-78f7-4f9b-9226-f8f43dca110a successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Temporary image da837564-8fa1-406b-bf22-f3687f2806e1 for user 5ab68e8c059c44e8b3c4956aadb1d02d is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Marking volume 5d7e0fc8-78f7-4f9b-9226-f8f43dca110a as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Copying metadata from image da837564-8fa1-406b-bf22-f3687f2806e1 to 5d7e0fc8-78f7-4f9b-9226-f8f43dca110a. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Creating volume glance metadata for volume 5d7e0fc8-78f7-4f9b-9226-f8f43dca110a backed by image da837564-8fa1-406b-bf22-f3687f2806e1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'da837564-8fa1-406b-bf22-f3687f2806e1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b9aecb2a31216b5366ecaca85bd7320e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed397352-2399-4797-a2ca-ff364bf93dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a', 'volume_size': 1, 'image_id': 'da837564-8fa1-406b-bf22-f3687f2806e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da837564-8fa1-406b-bf22-f3687f2806e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b9aecb2a31216b5366ecaca85bd7320e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38e2c0332f84414fa6dacd867a21b29b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e910e2452c3da385a27fe0c9b7b8b153017404fa694e26b6182002f1d5a6e0d55d63d74c4ac5ed9e34a8b49af766224da97e1d9eab3a89c8f50dba3246539e9', 'id': 'da837564-8fa1-406b-bf22-f3687f2806e1', 'created_at': datetime.datetime(2026, 9, 25, 15, 18, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 18, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da837564-8fa1-406b-bf22-f3687f2806e1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fa216b-8fd4-47b7-bf5d-3bda573da721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:06 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Volume volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a (5d7e0fc8-78f7-4f9b-9226-f8f43dca110a): created successfully Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fa216b-8fd4-47b7-bf5d-3bda573da721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Flow 'volume_create_manager' (ca739147-c8dd-4803-89a9-8b9b912287ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c7bf54bd-d898-4de7-b817-06bb7aadd83c tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Created volume successfully. Sep 25 17:19:06 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f.3b32ee83-defe-4419-8f7e-3f14a098e838" returned: 0 in 0.297s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-3b32ee83-defe-4419-8f7e-3f14a098e838" released by "_delete_snapshot" :: held 1.780s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" released by "delete_snapshot" :: held 1.805s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Created reservations ['37fd3c6e-0bfa-4ccf-b6a6-451ffa38d786', '683d62d9-f5b7-4ded-b2d5-720235ef6f46', '208bfd02-9a84-4c87-849b-92105f2a9b6e', '913ccf2d-ab13-4668-a601-e711dde1f3bb'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Delete snapshot completed successfully. Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9a0fa520-70f8-49e1-bc12-9b513aa7c327 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-3b32ee83-defe-4419-8f7e-3f14a098e838-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Acquiring lock "cinder-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "cinder-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Acquiring lock "cinder-quobyte-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "cinder-quobyte-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-1b76c9ca-74ea-4dab-92be-73dfe6489d0f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a6c49a-e050-4564-b488-b491ff70c182]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-1b76c9ca-74ea-4dab-92be-73dfe6489d0f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e13c2e4-909a-4bd2-a644-971beafa0dd7]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:06 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a Sep 25 17:19:06 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:07 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f Sep 25 17:19:07 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:07 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:07 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a Sep 25 17:19:07 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:07 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:07 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f Sep 25 17:19:07 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:07 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "cinder-quobyte-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a" released by "delete_volume" :: held 0.748s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:07 devstack cinder-volume[87232]: WARNING cinder.quota [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:19:07 devstack cinder-volume[87232]: WARNING cinder.quota [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Created reservations ['1230fe6c-4150-4045-9bff-bca01e66477c', '46d56256-a5ec-4b3f-a55c-4e73c0dcf016', '24d0bf4a-105e-4f4a-910a-32a1b7c9d15b', 'cc53b8a4-431b-4a2c-b089-78363efd63ee'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:07 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" returned: 0 in 0.287s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-1b76c9ca-74ea-4dab-92be-73dfe6489d0f" released by "delete_volume" :: held 0.744s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:07 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:07 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Created reservations ['71931329-f9ab-4190-86c8-27f52e1d5d21', 'eadbc166-1768-477f-967a-93e286858bb0', 'c5ea3f9b-38e8-4feb-994e-d6d4a769065e', '1af19dbb-fd6a-4f62-be88-bc51f91ca74d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:07 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:07 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:07 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.348s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Deleted volume successfully. Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ba3520e6-85dd-4ee3-b4cf-91fadd8a5493 tempest-VolumeAndVolumeTypeFromImageTest-150675059 None] Lock "cinder-5d7e0fc8-78f7-4f9b-9226-f8f43dca110a-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:08 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.338s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Deleted volume successfully. Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-23585e49-1bfa-4b3f-a7b3-cb2b946cf483 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-1b76c9ca-74ea-4dab-92be-73dfe6489d0f-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (14ceef83-598c-4f9a-8018-199034ff5600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97a00d2-dd24-48ff-b1de-a7ec9fb14117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97a00d2-dd24-48ff-b1de-a7ec9fb14117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-530919040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2f3887-dfd1-4557-aa52-e2caaf492b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5f6a1db1224d1ab41c444b6923ba8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:09Z,use_quota=True,user_id='666edb824f9148618404ab704c0d37f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27894fb2-0203-49ee-aedb-c0953acf3e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27894fb2-0203-49ee-aedb-c0953acf3e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e702a7ca-4aa6-4c10-abf3-1b2874aab383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e702a7ca-4aa6-4c10-abf3-1b2874aab383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2f3887-dfd1-4557-aa52-e2caaf492b22', 'volume_name': 'volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8418c5d-3b59-4308-8669-72997995b084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8418c5d-3b59-4308-8669-72997995b084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ff27a8-5570-4803-adc2-a2b306053e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Volume bf2f3887-dfd1-4557-aa52-e2caaf492b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22', 'volume_size': 1} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-530919040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2f3887-dfd1-4557-aa52-e2caaf492b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5f6a1db1224d1ab41c444b6923ba8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:09Z,use_quota=True,user_id='666edb824f9148618404ab704c0d37f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Creating volume bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:08 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:19:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:08 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 1073741824 Sep 25 17:19:08 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:09 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 1073741824" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:09 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 Sep 25 17:19:09 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:09 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22" returned: 0 in 0.311s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ff27a8-5570-4803-adc2-a2b306053e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f569988a-1afe-47c1-bb4b-b4a047f416d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Volume volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 (bf2f3887-dfd1-4557-aa52-e2caaf492b22): created successfully Sep 25 17:19:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f569988a-1afe-47c1-bb4b-b4a047f416d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (14ceef83-598c-4f9a-8018-199034ff5600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a6d308ca-da85-463f-8b08-f9d33170a9ed tempest-VolumesSnapshotTestJSON-90940879 None] Created volume successfully. Sep 25 17:19:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Creating offline snapshot 8a4e7184-1c87-47c4-a128-88d305c61bf1 of volume bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:19:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf863f3-262b-43fa-83d5-6ee3d711a78f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:11 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 Sep 25 17:19:11 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:11 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22" returned: 0 in 0.431s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:11 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 1G Sep 25 17:19:11 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:11 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 1G" returned: 0 in 0.490s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:11 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 Sep 25 17:19:11 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:12 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:12 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 is being set with open permissions: ugo+rw Sep 25 17:19:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:12 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 Sep 25 17:19:12 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:12 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1" returned: 0 in 0.268s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:12 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.info Sep 25 17:19:12 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:12 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.info" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:12 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.info is being set with open permissions: ugo+rw Sep 25 17:19:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:12 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.info Sep 25 17:19:12 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:13 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.info" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-56aff5ab-8bd2-45a6-8809-16cb550e80fa tempest-VolumesSnapshotTestJSON-90940879 None] Create snapshot completed successfully Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (3d429aa2-6403-49f2-ba92-f6d3dd65b3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8242da11-6094-410e-b54b-4372215464b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8242da11-6094-410e-b54b-4372215464b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1510196740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51640987-c2cb-48fc-9898-69399d419f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e5f6a1db1224d1ab41c444b6923ba8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a4e7184-1c87-47c4-a128-88d305c61bf1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:15Z,use_quota=True,user_id='666edb824f9148618404ab704c0d37f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd52e083-00d3-4b04-961d-c9d7939df79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd52e083-00d3-4b04-961d-c9d7939df79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fed0b5-8c69-4fc8-9344-403e53b385cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fed0b5-8c69-4fc8-9344-403e53b385cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '51640987-c2cb-48fc-9898-69399d419f78', 'volume_name': 'volume-51640987-c2cb-48fc-9898-69399d419f78', 'volume_size': 1, 'snapshot_id': '8a4e7184-1c87-47c4-a128-88d305c61bf1'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69279bd-d418-4b23-910a-0afd85c1529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e69279bd-d418-4b23-910a-0afd85c1529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0c0764-a8df-4da0-8a2b-69011aaa162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:14 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Volume 51640987-c2cb-48fc-9898-69399d419f78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-51640987-c2cb-48fc-9898-69399d419f78', 'volume_size': 1, 'snapshot_id': '8a4e7184-1c87-47c4-a128-88d305c61bf1'} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-8a4e7184-1c87-47c4-a128-88d305c61bf1-51640987-c2cb-48fc-9898-69399d419f78" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-8a4e7184-1c87-47c4-a128-88d305c61bf1-51640987-c2cb-48fc-9898-69399d419f78" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Creating volume 51640987-c2cb-48fc-9898-69399d419f78 from snapshot 8a4e7184-1c87-47c4-a128-88d305c61bf1 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-51640987-c2cb-48fc-9898-69399d419f78" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-51640987-c2cb-48fc-9898-69399d419f78" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] snapshot: 8a4e7184-1c87-47c4-a128-88d305c61bf1, volume: 51640987-c2cb-48fc-9898-69399d419f78, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec51759c-8f83-41eb-9dff-16f807f5f585]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:15 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 Sep 25 17:19:15 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:15 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[43edcc26-f9bf-4c31-8aa0-558840d73215]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:15 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 Sep 25 17:19:15 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:15 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22" returned: 0 in 0.413s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:15 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 Sep 25 17:19:15 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Flow 'volume_create_manager' (ba383ccd-bc84-47ee-86e6-d9134e74157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30226c9c-fe42-4d15-ad52-7d601cc9958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30226c9c-fe42-4d15-ad52-7d601cc9958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fbb647-2115-4848-affc-3cf13d60064a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820d159c50cb43c4a5d054f5b5e53f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:16Z,use_quota=True,user_id='4c3d97ba5d2d486a8724ed63ee903e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a050fd12-9325-4609-b2dd-06a53f5aa0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a050fd12-9325-4609-b2dd-06a53f5aa0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91979cdd-5c00-4bff-851d-c9e0565f853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:15 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:19:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91979cdd-5c00-4bff-851d-c9e0565f853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79fbb647-2115-4848-affc-3cf13d60064a', 'volume_name': 'volume-79fbb647-2115-4848-affc-3cf13d60064a', 'volume_size': 1, 'image_id': '793774d5-5732-4778-a3d4-979f262466b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/793774d5-5732-4778-a3d4-979f262466b9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2dea95d486a6a388cef1726434fa3f0d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '820d159c50cb43c4a5d054f5b5e53f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9bf1c811faf874c308de4ece7c9e2eaf4a73c199e6d8ced32ab9754721982e4067f75077e229091897bcb2f7bed1d0bb3d3f0e5cffade52bf7d2e04ff96a75b2', 'id': '793774d5-5732-4778-a3d4-979f262466b9', 'created_at': datetime.datetime(2026, 9, 25, 15, 19, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 19, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/793774d5-5732-4778-a3d4-979f262466b9/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b968fb34-6aa1-4601-904c-de44c4d40ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b968fb34-6aa1-4601-904c-de44c4d40ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24ffbda-3dce-4cec-93c2-2d7e454cddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Volume 79fbb647-2115-4848-affc-3cf13d60064a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79fbb647-2115-4848-affc-3cf13d60064a', 'volume_size': 1, 'image_id': '793774d5-5732-4778-a3d4-979f262466b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/793774d5-5732-4778-a3d4-979f262466b9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2dea95d486a6a388cef1726434fa3f0d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '820d159c50cb43c4a5d054f5b5e53f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9bf1c811faf874c308de4ece7c9e2eaf4a73c199e6d8ced32ab9754721982e4067f75077e229091897bcb2f7bed1d0bb3d3f0e5cffade52bf7d2e04ff96a75b2', 'id': '793774d5-5732-4778-a3d4-979f262466b9', 'created_at': datetime.datetime(2026, 9, 25, 15, 19, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 19, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/793774d5-5732-4778-a3d4-979f262466b9/file', 'properties': {}}, 'image_service': } Sep 25 17:19:16 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Trying to clone 79fbb647-2115-4848-affc-3cf13d60064a from image 793774d5-5732-4778-a3d4-979f262466b9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/793774d5-5732-4778-a3d4-979f262466b9', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:19:16 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:19:16 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Image download 0.00 MB at 0.00 MB/s Sep 25 17:19:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c19ad6-ecc9-459a-85e6-0568571cce56]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:16 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD Sep 25 17:19:16 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:17 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:17 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD Sep 25 17:19:17 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:17 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD" returned: 1 in 0.681s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:18 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Temporary image 793774d5-5732-4778-a3d4-979f262466b9 is fetched for user 4c3d97ba5d2d486a8724ed63ee903e06. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:19:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d91091-46c5-4eaa-a9f5-eb41a3326cc6]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:18 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD Sep 25 17:19:18 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:18 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD" returned: 0 in 0.665s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:19 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD Sep 25 17:19:19 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:19 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD" returned: 1 in 0.698s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-12ea9239-eaeb-4f50-9373-14d938bf2872 req-0f8126fd-e920-47f0-8c20-66365781de6f tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:23 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78" returned: 0 in 7.518s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:19:23 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Converted 1024.00 MB image at 136.18 MB/s Sep 25 17:19:23 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 is being set with open permissions: ugo+rw Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:23 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 Sep 25 17:19:23 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:23 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-51640987-c2cb-48fc-9898-69399d419f78" released by "_copy_volume_from_snapshot" :: held 8.700s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-8a4e7184-1c87-47c4-a128-88d305c61bf1-51640987-c2cb-48fc-9898-69399d419f78" released by "_create_volume_from_snapshot" :: held 8.762s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.779s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.921s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fbb647-2115-4848-affc-3cf13d60064a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820d159c50cb43c4a5d054f5b5e53f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:16Z,use_quota=True,user_id='4c3d97ba5d2d486a8724ed63ee903e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Creating volume 79fbb647-2115-4848-affc-3cf13d60064a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:23 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a 1073741824 Sep 25 17:19:23 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0c0764-a8df-4da0-8a2b-69011aaa162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51640987-c2cb-48fc-9898-69399d419f78', 'volume_size': 1, 'snapshot_id': '8a4e7184-1c87-47c4-a128-88d305c61bf1'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01b30e8-836d-430e-8dc3-b42c850235d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Volume volume-51640987-c2cb-48fc-9898-69399d419f78 (51640987-c2cb-48fc-9898-69399d419f78): created successfully Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01b30e8-836d-430e-8dc3-b42c850235d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Flow 'volume_create_manager' (3d429aa2-6403-49f2-ba92-f6d3dd65b3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6aaacf44-c842-4449-ba75-b769bb11913c tempest-VolumesSnapshotTestJSON-90940879 None] Created volume successfully. Sep 25 17:19:24 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a 1073741824" returned: 0 in 0.446s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:24 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a Sep 25 17:19:24 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:24 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a" returned: 0 in 0.257s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-12ea9239-eaeb-4f50-9373-14d938bf2872 req-0f8126fd-e920-47f0-8c20-66365781de6f tempest-TestStampPattern-376892887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.407s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-12ea9239-eaeb-4f50-9373-14d938bf2872 req-0f8126fd-e920-47f0-8c20-66365781de6f tempest-TestStampPattern-376892887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Attempting download of 793774d5-5732-4778-a3d4-979f262466b9 ((None, [{'url': 'file:///opt/stack/data/glance/images/793774d5-5732-4778-a3d4-979f262466b9', 'metadata': {}}])) to volume 79fbb647-2115-4848-affc-3cf13d60064a. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-12ea9239-eaeb-4f50-9373-14d938bf2872 req-0f8126fd-e920-47f0-8c20-66365781de6f tempest-TestStampPattern-376892887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-62deea70-53f4-49f9-89d8-20adcfbf426a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9895ada-7895-43e3-881a-46050e4a720f', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3d5cb8-a836-4c6f-b1fa-20bb026a7bb0]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_793774d5-5732-4778-a3d4-979f262466b9_m3p64n42 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-12ea9239-eaeb-4f50-9373-14d938bf2872 req-0f8126fd-e920-47f0-8c20-66365781de6f tempest-TestStampPattern-376892887 None] attachment_update completed successfully. Sep 25 17:19:24 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_793774d5-5732-4778-a3d4-979f262466b9_m3p64n42 Sep 25 17:19:24 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-51640987-c2cb-48fc-9898-69399d419f78-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-51640987-c2cb-48fc-9898-69399d419f78-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-51640987-c2cb-48fc-9898-69399d419f78" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-51640987-c2cb-48fc-9898-69399d419f78" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2da4ecd-8cc8-4d7c-a1d5-701e6bd1cecb]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:24 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_793774d5-5732-4778-a3d4-979f262466b9_m3p64n42" returned: 0 in 0.434s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_793774d5-5732-4778-a3d4-979f262466b9_m3p64n42 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:24 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 Sep 25 17:19:24 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:24 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_793774d5-5732-4778-a3d4-979f262466b9_m3p64n42 Sep 25 17:19:24 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:25 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_793774d5-5732-4778-a3d4-979f262466b9_m3p64n42" returned: 1 in 0.382s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_793774d5-5732-4778-a3d4-979f262466b9_m3p64n42' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ad60a0-9f35-49d4-a8c3-09392984f027]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:25 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78" returned: 0 in 0.451s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:25 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78 Sep 25 17:19:25 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:25 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD Sep 25 17:19:25 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:25 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-51640987-c2cb-48fc-9898-69399d419f78" returned: 0 in 0.346s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:25 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-51640987-c2cb-48fc-9898-69399d419f78" released by "delete_volume" :: held 0.888s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Created reservations ['1a40073a-e261-4285-a680-f4bff8c59c8c', '78abc6b9-8c1d-4c4f-9796-401cfb477cca', '102ed922-dbfd-41bf-99f2-3f30e83654ad', '497f365a-ea90-478a-8d46-37faaed91368'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:25 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD Sep 25 17:19:25 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:25 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:25 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-8a4e7184-1c87-47c4-a128-88d305c61bf1-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-8a4e7184-1c87-47c4-a128-88d305c61bf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-bf2f3887-dfd1-4557-aa52-e2caaf492b22" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-bf2f3887-dfd1-4557-aa52-e2caaf492b22" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-8a4e7184-1c87-47c4-a128-88d305c61bf1" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-8a4e7184-1c87-47c4-a128-88d305c61bf1" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Deleting offline snapshot 8a4e7184-1c87-47c4-a128-88d305c61bf1 of volume bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] snapshot_file for this snap is: volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2b63dc-5324-4ebf-8eef-ccc7f259c419]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:26 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD" returned: 1 in 0.528s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:26 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] 793774d5-5732-4778-a3d4-979f262466b9 was raw, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Deleted volume successfully. Sep 25 17:19:26 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a Sep 25 17:19:26 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f8981a2-4995-4ea9-a2d8-46a033b2d36c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-51640987-c2cb-48fc-9898-69399d419f78-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:26 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 Sep 25 17:19:26 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:26 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1" returned: 0 in 0.457s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed0148e-3e38-416a-8536-73ec76f76681]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:26 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 Sep 25 17:19:26 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:26 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a" returned: 0 in 0.655s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_793774d5-5732-4778-a3d4-979f262466b9__u_tsugudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:19:26 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 17:19:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:26 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a 1G Sep 25 17:19:26 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:27 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22" returned: 0 in 0.646s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:27 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a 1G" returned: 0 in 0.469s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Downloaded image 793774d5-5732-4778-a3d4-979f262466b9 ((None, [{'url': 'file:///opt/stack/data/glance/images/793774d5-5732-4778-a3d4-979f262466b9', 'metadata': {}}])) to volume 79fbb647-2115-4848-affc-3cf13d60064a successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Temporary image 793774d5-5732-4778-a3d4-979f262466b9 for user 4c3d97ba5d2d486a8724ed63ee903e06 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Marking volume 79fbb647-2115-4848-affc-3cf13d60064a as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:19:27 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 Sep 25 17:19:27 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Copying metadata from image 793774d5-5732-4778-a3d4-979f262466b9 to 79fbb647-2115-4848-affc-3cf13d60064a. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Creating volume glance metadata for volume 79fbb647-2115-4848-affc-3cf13d60064a backed by image 793774d5-5732-4778-a3d4-979f262466b9 with: {'image_id': '793774d5-5732-4778-a3d4-979f262466b9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2dea95d486a6a388cef1726434fa3f0d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24ffbda-3dce-4cec-93c2-2d7e454cddfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fbb647-2115-4848-affc-3cf13d60064a', 'volume_size': 1, 'image_id': '793774d5-5732-4778-a3d4-979f262466b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/793774d5-5732-4778-a3d4-979f262466b9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2dea95d486a6a388cef1726434fa3f0d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '820d159c50cb43c4a5d054f5b5e53f81', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9bf1c811faf874c308de4ece7c9e2eaf4a73c199e6d8ced32ab9754721982e4067f75077e229091897bcb2f7bed1d0bb3d3f0e5cffade52bf7d2e04ff96a75b2', 'id': '793774d5-5732-4778-a3d4-979f262466b9', 'created_at': datetime.datetime(2026, 9, 25, 15, 19, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 19, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/793774d5-5732-4778-a3d4-979f262466b9/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9eb6b8-dd4f-4b3a-825c-5e1c611a97a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:27 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Volume volume-79fbb647-2115-4848-affc-3cf13d60064a (79fbb647-2115-4848-affc-3cf13d60064a): created successfully Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9eb6b8-dd4f-4b3a-825c-5e1c611a97a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Flow 'volume_create_manager' (ba383ccd-bc84-47ee-86e6-d9134e74157b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7ea0d2d1-813d-499d-b7ba-4854d8133fca tempest-VolumeImageDependencyTests-1654155175 None] Created volume successfully. Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Acquiring lock "cinder-79fbb647-2115-4848-affc-3cf13d60064a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:27 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Lock "cinder-79fbb647-2115-4848-affc-3cf13d60064a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:27 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1 Sep 25 17:19:27 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Acquiring lock "cinder-quobyte-79fbb647-2115-4848-affc-3cf13d60064a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Lock "cinder-quobyte-79fbb647-2115-4848-affc-3cf13d60064a" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cee676e-7a99-4a91-b484-dcbec2e7f96a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:28 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a Sep 25 17:19:28 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:28 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22.8a4e7184-1c87-47c4-a128-88d305c61bf1" returned: 0 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-841c64fe-c104-4a82-9e81-7b01c941f335 req-181751de-d436-457e-8c78-422e222f9f28 tempest-TestStampPattern-376892887 None] Terminate volume connection completed successfully. Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-841c64fe-c104-4a82-9e81-7b01c941f335 req-181751de-d436-457e-8c78-422e222f9f28 tempest-TestStampPattern-376892887 None] Deleting attachment c9895ada-7895-43e3-881a-46050e4a720f. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-8a4e7184-1c87-47c4-a128-88d305c61bf1" released by "_delete_snapshot" :: held 2.158s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-bf2f3887-dfd1-4557-aa52-e2caaf492b22" released by "delete_snapshot" :: held 2.201s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Created reservations ['1f5e2d7d-68f1-4bcc-9308-d73b2385858a', 'cf825e60-df61-460c-b779-52e71c2f44f2', '09476107-dba2-460c-a6fc-0366ba27cd7f', '202569cd-82e3-46f7-bdac-49f283bcf00c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Delete snapshot completed successfully. Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bf13f045-78c2-4514-af26-1bab12b34421 tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-8a4e7184-1c87-47c4-a128-88d305c61bf1-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:28 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a" returned: 0 in 0.518s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:28 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a Sep 25 17:19:28 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:28 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-79fbb647-2115-4848-affc-3cf13d60064a" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Lock "cinder-quobyte-79fbb647-2115-4848-affc-3cf13d60064a" released by "delete_volume" :: held 0.873s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Created reservations ['5ce5f0e1-c300-4a21-b1df-9cfd4a66ce17', 'ab150a63-23f9-4f55-9e49-e1a96ec444c5', '5bcdb0a4-8cc4-42e9-a421-dbcadb31dcca', '4332a895-a8aa-4522-bfeb-96e7a576fe8c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:29 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:29 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:29 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.360s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:29 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Deleted volume successfully. Sep 25 17:19:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-bf2f3887-dfd1-4557-aa52-e2caaf492b22-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-bf2f3887-dfd1-4557-aa52-e2caaf492b22-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4cca192a-0c00-484b-9b72-e078f5704df7 tempest-VolumeImageDependencyTests-1654155175 None] Lock "cinder-79fbb647-2115-4848-affc-3cf13d60064a-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-bf2f3887-dfd1-4557-aa52-e2caaf492b22" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:29 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-bf2f3887-dfd1-4557-aa52-e2caaf492b22" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5acfddc-8453-4416-a5c1-819ed0e6d6fe]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:29 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 Sep 25 17:19:29 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:30 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22" returned: 0 in 0.615s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:30 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22 Sep 25 17:19:30 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:30 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bf2f3887-dfd1-4557-aa52-e2caaf492b22" returned: 0 in 0.602s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-bf2f3887-dfd1-4557-aa52-e2caaf492b22" released by "delete_volume" :: held 1.359s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:30 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Created reservations ['d365cf86-2ef3-405c-9b57-2a9addc359a8', 'abfa3e90-6681-4027-8948-cbbe5f986a96', 'fdea8a15-2a0b-4d54-9e8b-ad1a5c3006db', 'f5a64d63-4ea1-4792-aeb9-35fde3aa307c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:31 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:31 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:31 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Deleted volume successfully. Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3d85ea1c-e322-43ff-8a90-68f8b47eeb1d tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-bf2f3887-dfd1-4557-aa52-e2caaf492b22-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-81da5424-3afa-4e10-aa7a-055e21498369-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-81da5424-3afa-4e10-aa7a-055e21498369-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "cinder-quobyte-81da5424-3afa-4e10-aa7a-055e21498369" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-81da5424-3afa-4e10-aa7a-055e21498369" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eadba53-a5d3-4de6-a8b6-a42518bb2b9a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:32 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 Sep 25 17:19:32 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:32 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369" returned: 0 in 0.598s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:32 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369 Sep 25 17:19:32 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:32 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-81da5424-3afa-4e10-aa7a-055e21498369" returned: 0 in 0.288s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-quobyte-81da5424-3afa-4e10-aa7a-055e21498369" released by "delete_volume" :: held 1.003s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Created reservations ['0b9466b3-85b9-4efa-980d-f03264c59767', '2b5266db-250d-4a23-ade7-5ab67b6db02b', '17080a2c-1a64-408e-a1d2-37e79c1a096c', '98cee5a9-70c6-4eef-8384-fbcdd95dc095'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:33 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:33 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Acquiring lock "cinder-62deea70-53f4-49f9-89d8-20adcfbf426a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Lock "cinder-62deea70-53f4-49f9-89d8-20adcfbf426a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:33 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Acquiring lock "cinder-quobyte-62deea70-53f4-49f9-89d8-20adcfbf426a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Deleted volume successfully. Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-62deea70-53f4-49f9-89d8-20adcfbf426a" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f3baa16-acba-4153-ad6c-e86647d44d7c tempest-VolumesSnapshotTestJSON-90940879 None] Lock "cinder-81da5424-3afa-4e10-aa7a-055e21498369-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[99703423-f24a-4aff-b820-a2f0e28c406a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:33 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a Sep 25 17:19:33 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:33 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a" returned: 0 in 0.414s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:33 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a Sep 25 17:19:33 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:34 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-62deea70-53f4-49f9-89d8-20adcfbf426a" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-62deea70-53f4-49f9-89d8-20adcfbf426a" released by "delete_volume" :: held 0.804s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Flow 'volume_create_manager' (9b9de411-c51b-4e20-9b63-0a38bde3ebca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390c2626-7663-4860-8732-25bcb011ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390c2626-7663-4860-8732-25bcb011ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5378fe1-3e4f-431b-accd-5032cd756e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1864bb57cd5c4deda68062d4f5e03a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:34Z,use_quota=True,user_id='768faee6bfd849f29406006ba9c37017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88d6ed9-8779-4200-8d0a-85da2c090e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88d6ed9-8779-4200-8d0a-85da2c090e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0670789-d646-418d-b115-07dc050a8d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0670789-d646-418d-b115-07dc050a8d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5378fe1-3e4f-431b-accd-5032cd756e89', 'volume_name': 'volume-b5378fe1-3e4f-431b-accd-5032cd756e89', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45cd7e4f-7d4d-43db-aaa3-1818d3415d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45cd7e4f-7d4d-43db-aaa3-1818d3415d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90000297-1bf2-46f7-9e09-eb60cbc14a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Volume b5378fe1-3e4f-431b-accd-5032cd756e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5378fe1-3e4f-431b-accd-5032cd756e89', 'volume_size': 1} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5378fe1-3e4f-431b-accd-5032cd756e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1864bb57cd5c4deda68062d4f5e03a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:34Z,use_quota=True,user_id='768faee6bfd849f29406006ba9c37017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Creating volume b5378fe1-3e4f-431b-accd-5032cd756e89 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:34 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:34 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89 1073741824 Sep 25 17:19:34 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Created reservations ['329c588c-9447-4f6f-98f5-4aabdf2214e7', '791f33e9-4a03-47e1-9a6c-9594e868cdea', 'af251c01-e86b-43f1-9549-38440103207d', '817e757a-19e7-4079-8b31-7228ddb5ee1f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:34 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:34 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:34 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.294s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Deleted volume successfully. Sep 25 17:19:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0c930494-7d48-45b0-896b-e6942f2153fd tempest-TestStampPattern-376892887 None] Lock "cinder-62deea70-53f4-49f9-89d8-20adcfbf426a-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:35 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89 1073741824" returned: 0 in 0.548s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:35 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89 Sep 25 17:19:35 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:35 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90000297-1bf2-46f7-9e09-eb60cbc14a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5378fe1-3e4f-431b-accd-5032cd756e89', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579206cb-d991-4756-ad0d-9926979b7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Volume volume-b5378fe1-3e4f-431b-accd-5032cd756e89 (b5378fe1-3e4f-431b-accd-5032cd756e89): created successfully Sep 25 17:19:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579206cb-d991-4756-ad0d-9926979b7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Flow 'volume_create_manager' (9b9de411-c51b-4e20-9b63-0a38bde3ebca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-95231cff-d048-483e-9647-54cc0d225332 tempest-CinderUnicodeTest-1676528552 None] Created volume successfully. Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Acquiring lock "cinder-3dec584f-95b1-47a6-b55d-5d362e61efa0-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Lock "cinder-3dec584f-95b1-47a6-b55d-5d362e61efa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Acquiring lock "cinder-quobyte-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Acquiring lock "cinder-quobyte-3dec584f-95b1-47a6-b55d-5d362e61efa0" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-3dec584f-95b1-47a6-b55d-5d362e61efa0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Deleting offline snapshot 3dec584f-95b1-47a6-b55d-5d362e61efa0 of volume 663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] snapshot_file for this snap is: volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3edced1-9ba6-4c07-becb-06939e09e012]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:36 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 Sep 25 17:19:36 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:36 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0" returned: 0 in 0.427s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d187260-408b-4aa8-96b6-757c91e312f8]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:36 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb Sep 25 17:19:36 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Flow 'volume_create_manager' (5fecfd5c-b636-4f78-83a4-37743fc7fe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4160ecbe-672c-4341-85c5-dab3f4a74522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:37 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" returned: 0 in 0.630s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4160ecbe-672c-4341-85c5-dab3f4a74522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1122398811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd07cd94-7a35-4554-a388-49e27fca89eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1864bb57cd5c4deda68062d4f5e03a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:37Z,use_quota=True,user_id='768faee6bfd849f29406006ba9c37017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:37 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 Sep 25 17:19:37 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b634da09-ffb1-4abc-8891-cb1412fa0d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b634da09-ffb1-4abc-8891-cb1412fa0d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b9ce8f-d5e6-405d-99e0-4acc3e130a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b9ce8f-d5e6-405d-99e0-4acc3e130a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd07cd94-7a35-4554-a388-49e27fca89eb', 'volume_name': 'volume-bd07cd94-7a35-4554-a388-49e27fca89eb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bae152-2005-4e93-b4e5-58ae7e2846bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bae152-2005-4e93-b4e5-58ae7e2846bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b4a21f-c539-4127-86b9-d921a9a88a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Volume bd07cd94-7a35-4554-a388-49e27fca89eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd07cd94-7a35-4554-a388-49e27fca89eb', 'volume_size': 1} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1122398811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd07cd94-7a35-4554-a388-49e27fca89eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1864bb57cd5c4deda68062d4f5e03a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:37Z,use_quota=True,user_id='768faee6bfd849f29406006ba9c37017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Creating volume bd07cd94-7a35-4554-a388-49e27fca89eb {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:37 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:37 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb 1073741824 Sep 25 17:19:37 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:37 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0" returned: 0 in 0.420s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:37 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0 Sep 25 17:19:37 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:37 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb 1073741824" returned: 0 in 0.493s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:37 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb Sep 25 17:19:37 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:37 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb.3dec584f-95b1-47a6-b55d-5d362e61efa0" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-3dec584f-95b1-47a6-b55d-5d362e61efa0" released by "_delete_snapshot" :: held 1.905s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" released by "delete_snapshot" :: held 1.935s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:38 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Created reservations ['9dfd81cd-ed87-425e-b002-7beffc19cc97', 'd4a71c00-9efd-4f87-ad84-ca4622c7dbfa', '09412582-f12d-4403-8058-3afc8af50553', '63cc587f-6aae-42cb-9b28-492bdb92f3d6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Delete snapshot completed successfully. Sep 25 17:19:38 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1bcd2c8e-6f74-4567-88fb-09d27524395b tempest-TestStampPattern-376892887 None] Lock "cinder-3dec584f-95b1-47a6-b55d-5d362e61efa0-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b4a21f-c539-4127-86b9-d921a9a88a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd07cd94-7a35-4554-a388-49e27fca89eb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92fa292-9258-43de-84d3-6321c9036bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Volume volume-bd07cd94-7a35-4554-a388-49e27fca89eb (bd07cd94-7a35-4554-a388-49e27fca89eb): created successfully Sep 25 17:19:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92fa292-9258-43de-84d3-6321c9036bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Flow 'volume_create_manager' (5fecfd5c-b636-4f78-83a4-37743fc7fe88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c5c314eb-8a4a-46de-8db4-4fddf2134504 tempest-CinderUnicodeTest-1676528552 None] Created volume successfully. Sep 25 17:19:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Creating offline snapshot 3020d3be-5fae-4123-bf4b-2cb5ed396581 of volume bd07cd94-7a35-4554-a388-49e27fca89eb {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:19:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[730ea724-a0a9-403c-aeb6-da9ac7c018f0]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:40 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb Sep 25 17:19:40 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:40 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb" returned: 0 in 0.817s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:40 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 1G Sep 25 17:19:40 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:41 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 1G" returned: 0 in 0.639s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd07cd94-7a35-4554-a388-49e27fca89eb -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:41 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd07cd94-7a35-4554-a388-49e27fca89eb -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 Sep 25 17:19:41 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:41 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd07cd94-7a35-4554-a388-49e27fca89eb -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581" returned: 0 in 0.394s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:41 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 is being set with open permissions: ugo+rw Sep 25 17:19:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:41 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 Sep 25 17:19:41 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:42 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581" returned: 0 in 0.457s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:42 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.info Sep 25 17:19:42 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:42 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.info" returned: 0 in 0.332s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:42 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.info is being set with open permissions: ugo+rw Sep 25 17:19:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:42 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.info Sep 25 17:19:42 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:42 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.info" returned: 0 in 0.312s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5d081279-2190-451c-bafc-2c0fd960f436 tempest-CinderUnicodeTest-1676528552 None] Create snapshot completed successfully Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Acquiring lock "cinder-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Lock "cinder-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Acquiring lock "cinder-quobyte-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc09841f-de3c-40c5-921d-36344f8c5d19]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:43 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb Sep 25 17:19:43 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:43 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:43 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb Sep 25 17:19:43 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "cinder-3020d3be-5fae-4123-bf4b-2cb5ed396581-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-3020d3be-5fae-4123-bf4b-2cb5ed396581-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "cinder-quobyte-bd07cd94-7a35-4554-a388-49e27fca89eb" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-quobyte-bd07cd94-7a35-4554-a388-49e27fca89eb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "cinder-quobyte-3020d3be-5fae-4123-bf4b-2cb5ed396581" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-quobyte-3020d3be-5fae-4123-bf4b-2cb5ed396581" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Deleting offline snapshot 3020d3be-5fae-4123-bf4b-2cb5ed396581 of volume bd07cd94-7a35-4554-a388-49e27fca89eb {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:19:43 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] snapshot_file for this snap is: volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c58b1f4-50ff-445f-86ca-0c7d24b43d9b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Lock "cinder-quobyte-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb" released by "delete_volume" :: held 0.824s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Created reservations ['dc5ee975-2c0b-42fd-a790-fd38b15d0ad7', '77a79ce1-dad1-4e83-b83b-ba7cef21593c', '174df012-6d0c-4b87-9696-327ed18a5e25', '18ce41bf-0a80-4e19-be9b-ae642775e18a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:44 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 Sep 25 17:19:44 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:44 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:44 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:44 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.305s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Deleted volume successfully. Sep 25 17:19:44 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581" returned: 0 in 0.506s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd07cd94-7a35-4554-a388-49e27fca89eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7cc7df7b-7993-470b-8f6b-5c84180a8bb9 tempest-TestStampPattern-376892887 None] Lock "cinder-663e4aca-2f80-4d04-b0b4-4ec775d5ebfb-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4afb205-1a4d-4e3b-a965-2418d1375741]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:44 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb Sep 25 17:19:44 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:45 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb" returned: 0 in 0.508s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:45 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 Sep 25 17:19:45 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Flow 'volume_create_manager' (c765f54b-465a-42b5-bcdd-7608ba2d8072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e656e1-496d-4aca-b81c-e1bfb3060966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e656e1-496d-4aca-b81c-e1bfb3060966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-441950030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69ac03c-24bf-4667-a7df-45623c4ccfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173ea57e91154966ba789c24190d0ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:45Z,use_quota=True,user_id='40fc3273ebee42bdbfdddc421fed29ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe22ef57-ce79-45b4-b6c2-68554e202fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe22ef57-ce79-45b4-b6c2-68554e202fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b6ad72-fab0-439b-b794-dc08c15faba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b6ad72-fab0-439b-b794-dc08c15faba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd69ac03c-24bf-4667-a7df-45623c4ccfef', 'volume_name': 'volume-d69ac03c-24bf-4667-a7df-45623c4ccfef', 'volume_size': 2}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfcfdfd-0ba0-4b8f-a672-7ac051c96005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfcfdfd-0ba0-4b8f-a672-7ac051c96005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2d83b9-f957-4423-9467-0d12c92c0186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Volume d69ac03c-24bf-4667-a7df-45623c4ccfef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d69ac03c-24bf-4667-a7df-45623c4ccfef', 'volume_size': 2} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-441950030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69ac03c-24bf-4667-a7df-45623c4ccfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173ea57e91154966ba789c24190d0ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:19:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:19:45Z,use_quota=True,user_id='40fc3273ebee42bdbfdddc421fed29ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Creating volume d69ac03c-24bf-4667-a7df-45623c4ccfef {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:19:45 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef 2147483648 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:45 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef 2147483648 Sep 25 17:19:45 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:45 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581" returned: 0 in 0.495s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:45 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581 Sep 25 17:19:45 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:45 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb.3020d3be-5fae-4123-bf4b-2cb5ed396581" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-quobyte-3020d3be-5fae-4123-bf4b-2cb5ed396581" released by "_delete_snapshot" :: held 1.987s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-quobyte-bd07cd94-7a35-4554-a388-49e27fca89eb" released by "delete_snapshot" :: held 2.013s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:46 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef 2147483648" returned: 0 in 0.679s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Created reservations ['040ff9e8-7ecd-4227-938d-b54195a749f9', '43542019-0435-4b1b-aa55-57729c61b288', 'd4edeac6-033e-4cff-bc6a-8dda9c3787dc', 'c7973614-64ef-4e8c-87b7-1d91a4e6a9f6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:46 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef Sep 25 17:19:46 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Delete snapshot completed successfully. Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a1c21936-7dd6-4f81-aa7d-82a849449bcb tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-3020d3be-5fae-4123-bf4b-2cb5ed396581-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:46 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef" returned: 0 in 0.300s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2d83b9-f957-4423-9467-0d12c92c0186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69ac03c-24bf-4667-a7df-45623c4ccfef', 'volume_size': 2}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74a173a-999b-41e9-b705-1d9e35d36e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:19:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Volume volume-d69ac03c-24bf-4667-a7df-45623c4ccfef (d69ac03c-24bf-4667-a7df-45623c4ccfef): created successfully Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74a173a-999b-41e9-b705-1d9e35d36e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:19:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Flow 'volume_create_manager' (c765f54b-465a-42b5-bcdd-7608ba2d8072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:19:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6427024b-bb9b-4f77-b772-9743476cc52a tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Created volume successfully. Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "cinder-bd07cd94-7a35-4554-a388-49e27fca89eb-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-bd07cd94-7a35-4554-a388-49e27fca89eb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "cinder-quobyte-bd07cd94-7a35-4554-a388-49e27fca89eb" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-quobyte-bd07cd94-7a35-4554-a388-49e27fca89eb" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[747bcb9e-1155-4639-9e9c-24ff10d7a2be]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:47 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb Sep 25 17:19:47 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Creating offline snapshot 07dd46c1-4d90-4afa-997a-5a31d85640a5 of volume d69ac03c-24bf-4667-a7df-45623c4ccfef {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8c7174-6f55-49a0-89a8-3c4eab6180e9]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:47 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef Sep 25 17:19:47 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:47 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb" returned: 0 in 0.483s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:47 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb Sep 25 17:19:47 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:48 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef" returned: 0 in 0.484s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 2G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:48 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 2G Sep 25 17:19:48 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:48 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bd07cd94-7a35-4554-a388-49e27fca89eb" returned: 0 in 0.330s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-quobyte-bd07cd94-7a35-4554-a388-49e27fca89eb" released by "delete_volume" :: held 0.913s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Created reservations ['2f88fc16-9869-47f2-914b-f050de5583f1', '81ba7657-9bc7-4e99-85b7-95a66dcc6fb6', 'd02f97ec-7a28-4417-8671-df869b16267e', 'd2909ad4-de85-47d7-bb5a-f9222aa23f31'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:48 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:48 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:48 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 2G" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d69ac03c-24bf-4667-a7df-45623c4ccfef -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:48 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d69ac03c-24bf-4667-a7df-45623c4ccfef -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 Sep 25 17:19:48 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:48 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Deleted volume successfully. Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-06424890-1ff1-4f52-bb25-21d2a6678dd8 tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-bd07cd94-7a35-4554-a388-49e27fca89eb-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:48 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d69ac03c-24bf-4667-a7df-45623c4ccfef -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5" returned: 0 in 0.399s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:48 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 is being set with open permissions: ugo+rw Sep 25 17:19:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:49 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 Sep 25 17:19:49 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:49 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5" returned: 0 in 0.302s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:49 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.info Sep 25 17:19:49 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "cinder-b5378fe1-3e4f-431b-accd-5032cd756e89-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-b5378fe1-3e4f-431b-accd-5032cd756e89-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "cinder-quobyte-b5378fe1-3e4f-431b-accd-5032cd756e89" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-quobyte-b5378fe1-3e4f-431b-accd-5032cd756e89" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22e8e59-d6a6-4ce4-83e4-38f8168d7a1e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:49 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.info" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:49 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.info is being set with open permissions: ugo+rw Sep 25 17:19:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:49 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.info Sep 25 17:19:49 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:49 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89 Sep 25 17:19:49 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:50 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.info" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6d7b1312-c34d-46cf-a9b4-f190527d34ce tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Create snapshot completed successfully Sep 25 17:19:50 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89" returned: 0 in 0.533s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:50 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89 Sep 25 17:19:50 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:50 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5378fe1-3e4f-431b-accd-5032cd756e89" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-quobyte-b5378fe1-3e4f-431b-accd-5032cd756e89" released by "delete_volume" :: held 0.899s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=120,cinder:INSERT=43,cinder:UPDATE=137,cinder:DELETE=11 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=138,cinder:SELECT=125,cinder:INSERT=44,cinder:DELETE=11 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Created reservations ['b21c022e-442a-4d2e-afa0-faafd4bcb086', '888520dd-7756-4098-a4d5-42dcdbcaa75b', '41ee7c3a-18e9-4be6-99ac-28851047fd25', '4eec5b2b-a49c-419d-84e0-86eac2a99d1e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:50 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:50 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Acquiring lock "cinder-07dd46c1-4d90-4afa-997a-5a31d85640a5-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-07dd46c1-4d90-4afa-997a-5a31d85640a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Acquiring lock "cinder-quobyte-d69ac03c-24bf-4667-a7df-45623c4ccfef" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-quobyte-d69ac03c-24bf-4667-a7df-45623c4ccfef" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Acquiring lock "cinder-quobyte-07dd46c1-4d90-4afa-997a-5a31d85640a5" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-quobyte-07dd46c1-4d90-4afa-997a-5a31d85640a5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Deleting offline snapshot 07dd46c1-4d90-4afa-997a-5a31d85640a5 of volume d69ac03c-24bf-4667-a7df-45623c4ccfef {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] snapshot_file for this snap is: volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4c6b1b-6121-4a37-b0c6-cac4af862c4d]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:50 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:50 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Deleted volume successfully. Sep 25 17:19:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7ea7a71-dfc8-4d86-8cee-866e61fc564e tempest-CinderUnicodeTest-1676528552 None] Lock "cinder-b5378fe1-3e4f-431b-accd-5032cd756e89-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:51 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 Sep 25 17:19:51 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:51 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5" returned: 0 in 0.474s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d69ac03c-24bf-4667-a7df-45623c4ccfef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:19:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4861f0f3-5793-4e7c-b781-478889e93040]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:51 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef Sep 25 17:19:51 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:51 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef" returned: 0 in 0.449s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:51 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 Sep 25 17:19:51 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:52 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5" returned: 0 in 0.475s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:52 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5 Sep 25 17:19:52 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:52 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef.07dd46c1-4d90-4afa-997a-5a31d85640a5" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-quobyte-07dd46c1-4d90-4afa-997a-5a31d85640a5" released by "_delete_snapshot" :: held 1.853s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-quobyte-d69ac03c-24bf-4667-a7df-45623c4ccfef" released by "delete_snapshot" :: held 1.882s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:52 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Created reservations ['f9324558-9c81-4f23-ae2d-f1afcd7c1568', '2557d644-5f6d-46e2-b37a-600ecf2c726c', '6da9ded8-8065-402f-8959-26fc5bad5e9c', '101525e6-a20f-4529-b816-bf0f75a328d5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Delete snapshot completed successfully. Sep 25 17:19:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-70867cd8-7dd5-4b21-aa37-1de166ce3ac4 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-07dd46c1-4d90-4afa-997a-5a31d85640a5-delete_snapshot" released by "delete_snapshot" :: held 2.061s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Acquiring lock "cinder-d69ac03c-24bf-4667-a7df-45623c4ccfef-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-d69ac03c-24bf-4667-a7df-45623c4ccfef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Acquiring lock "cinder-quobyte-d69ac03c-24bf-4667-a7df-45623c4ccfef" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:19:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-quobyte-d69ac03c-24bf-4667-a7df-45623c4ccfef" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:19:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9224f7b5-ed38-4441-8dd0-e7ff8f69d710]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:19:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:53 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef Sep 25 17:19:53 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:53 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef" returned: 0 in 0.479s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:53 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef Sep 25 17:19:53 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:54 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d69ac03c-24bf-4667-a7df-45623c4ccfef" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-quobyte-d69ac03c-24bf-4667-a7df-45623c4ccfef" released by "delete_volume" :: held 0.876s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Created reservations ['82e3ddd3-126e-4703-9568-21f852b955b1', '625e3f12-6e3a-442a-8fb0-e320f0045f84', '5a78b3b1-191d-4c64-8082-4a42789985aa', '3ceabb88-c521-4ad4-9d0b-6e17bbb4caf8'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:54 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:54 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:54 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.326s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Deleted volume successfully. Sep 25 17:19:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-aad8db8f-10ad-4ac7-8e4b-bd482f193b01 tempest-VolumesSnapshotNegativeTestJSON-1008954092 None] Lock "cinder-d69ac03c-24bf-4667-a7df-45623c4ccfef-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:19:56 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:19:56 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:19:56 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:19:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (de6b2d2c-6139-4b7b-b4dd-a82648cb9406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5edb8d4-7f4f-48ef-a47e-d33a29c2c08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5edb8d4-7f4f-48ef-a47e-d33a29c2c08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233477320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c095ba06-debc-48f9-b553-e47fe2b999d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:00Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7554f5-487a-4801-942a-16c81442f0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7554f5-487a-4801-942a-16c81442f0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a503b0d6-c28a-4fb6-a192-0fa6300d951e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a503b0d6-c28a-4fb6-a192-0fa6300d951e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c095ba06-debc-48f9-b553-e47fe2b999d8', 'volume_name': 'volume-c095ba06-debc-48f9-b553-e47fe2b999d8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07f7419-ce43-4d0b-9b64-53f1e1d1fc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07f7419-ce43-4d0b-9b64-53f1e1d1fc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95ff31c-e2a3-4252-b323-78905956f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Volume c095ba06-debc-48f9-b553-e47fe2b999d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c095ba06-debc-48f9-b553-e47fe2b999d8', 'volume_size': 1} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233477320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c095ba06-debc-48f9-b553-e47fe2b999d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:00Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Creating volume c095ba06-debc-48f9-b553-e47fe2b999d8 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:00 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:00 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8 1073741824 Sep 25 17:20:00 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (1b5b8c34-c39d-43c3-9c68-4203f7747e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64bcaed-e833-42f5-9698-7f4f1ca6613e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64bcaed-e833-42f5-9698-7f4f1ca6613e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1986750798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c3915d-982f-4e33-ba84-d5993845f76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:01Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb1015f-ab49-4cbd-9824-5a8de8f7d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb1015f-ab49-4cbd-9824-5a8de8f7d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cb35c1-55dc-4def-b0c7-fef0178aaed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cb35c1-55dc-4def-b0c7-fef0178aaed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c3915d-982f-4e33-ba84-d5993845f76c', 'volume_name': 'volume-c2c3915d-982f-4e33-ba84-d5993845f76c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461c6d09-e127-431d-a075-09afc5a0f833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461c6d09-e127-431d-a075-09afc5a0f833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a686b97-3d93-40ea-b7f2-f4e87e020887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Volume c2c3915d-982f-4e33-ba84-d5993845f76c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c3915d-982f-4e33-ba84-d5993845f76c', 'volume_size': 1} Sep 25 17:20:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:01 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8 1073741824" returned: 0 in 0.751s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:01 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8 Sep 25 17:20:01 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (dad6bf3b-caa8-4f28-8999-badeb1987308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b781ccac-40c8-4acc-a80b-458f613bee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b781ccac-40c8-4acc-a80b-458f613bee46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104273310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096274f0-d0c4-46d4-a201-715301f634b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:01Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f51887-ddec-4818-9213-b861495acb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f51887-ddec-4818-9213-b861495acb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717a04f5-4444-4a05-8f28-e82a4434ebca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717a04f5-4444-4a05-8f28-e82a4434ebca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096274f0-d0c4-46d4-a201-715301f634b8', 'volume_name': 'volume-096274f0-d0c4-46d4-a201-715301f634b8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c72ebb-aeda-499b-b02e-d57f3023af53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c72ebb-aeda-499b-b02e-d57f3023af53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c660ab3b-12c0-447a-9302-56096b77586f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Volume 096274f0-d0c4-46d4-a201-715301f634b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096274f0-d0c4-46d4-a201-715301f634b8', 'volume_size': 1} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:01 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8" returned: 0 in 0.462s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1986750798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c3915d-982f-4e33-ba84-d5993845f76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:01Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Creating volume c2c3915d-982f-4e33-ba84-d5993845f76c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:01 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95ff31c-e2a3-4252-b323-78905956f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c095ba06-debc-48f9-b553-e47fe2b999d8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3393c363-218b-4bbf-b3dc-288b55e2dea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c 1073741824 Sep 25 17:20:01 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Volume volume-c095ba06-debc-48f9-b553-e47fe2b999d8 (c095ba06-debc-48f9-b553-e47fe2b999d8): created successfully Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3393c363-218b-4bbf-b3dc-288b55e2dea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (de6b2d2c-6139-4b7b-b4dd-a82648cb9406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fb1d6586-e472-42f8-bae7-7a9f1e72f139 tempest-CreateVolumesFromImageTest-54046104 None] Created volume successfully. Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (09e18111-3020-4858-b00b-3e91e81cdc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae5e199-3882-4775-a678-784051f7fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae5e199-3882-4775-a678-784051f7fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-513288354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505fd716-d827-45ea-b4f9-4e1810c63aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:02Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17eff8ca-b01f-49af-97a7-767963b88075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17eff8ca-b01f-49af-97a7-767963b88075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbd96f0-a727-4c4f-aba5-e4fdade86dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbd96f0-a727-4c4f-aba5-e4fdade86dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505fd716-d827-45ea-b4f9-4e1810c63aff', 'volume_name': 'volume-505fd716-d827-45ea-b4f9-4e1810c63aff', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfda647-4231-42f4-afee-8f90e428e9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfda647-4231-42f4-afee-8f90e428e9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed20d23c-a9c0-4325-888b-93fa3a1b5757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:01 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Volume 505fd716-d827-45ea-b4f9-4e1810c63aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505fd716-d827-45ea-b4f9-4e1810c63aff', 'volume_size': 1} Sep 25 17:20:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:02 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c 1073741824" returned: 0 in 0.717s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (b243d71b-b634-4d60-aa88-52ee67cc810c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1b8f6d-5779-4696-9235-0598205779b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:02 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c Sep 25 17:20:02 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1b8f6d-5779-4696-9235-0598205779b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-347382955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865d2e48-fab4-410e-9f6b-6f146631da17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:02Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee0b941-f079-4609-a70d-7f55ae93df88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee0b941-f079-4609-a70d-7f55ae93df88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b248943f-a1f4-4822-b0f0-90b1182e5592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b248943f-a1f4-4822-b0f0-90b1182e5592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865d2e48-fab4-410e-9f6b-6f146631da17', 'volume_name': 'volume-865d2e48-fab4-410e-9f6b-6f146631da17', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87bfb76-ec34-4cf2-b1ff-c44ad9db7e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87bfb76-ec34-4cf2-b1ff-c44ad9db7e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9816058-6cde-4074-adf1-61635cde46c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Volume 865d2e48-fab4-410e-9f6b-6f146631da17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865d2e48-fab4-410e-9f6b-6f146631da17', 'volume_size': 1} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:02 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c" returned: 0 in 0.300s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104273310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096274f0-d0c4-46d4-a201-715301f634b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:01Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Creating volume 096274f0-d0c4-46d4-a201-715301f634b8 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:02 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a686b97-3d93-40ea-b7f2-f4e87e020887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c3915d-982f-4e33-ba84-d5993845f76c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:02 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8 1073741824 Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e427de10-be85-408f-8804-7319a205b0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:02 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:02 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Volume volume-c2c3915d-982f-4e33-ba84-d5993845f76c (c2c3915d-982f-4e33-ba84-d5993845f76c): created successfully Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e427de10-be85-408f-8804-7319a205b0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:02 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (1b5b8c34-c39d-43c3-9c68-4203f7747e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9911afe9-03b4-4879-a18d-f2feeb187786 tempest-CreateVolumesFromImageTest-54046104 None] Created volume successfully. Sep 25 17:20:03 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8 1073741824" returned: 0 in 0.568s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:03 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8 Sep 25 17:20:03 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:03 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-513288354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505fd716-d827-45ea-b4f9-4e1810c63aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:02Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Creating volume 505fd716-d827-45ea-b4f9-4e1810c63aff {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:03 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:03 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff 1073741824 Sep 25 17:20:03 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c660ab3b-12c0-447a-9302-56096b77586f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096274f0-d0c4-46d4-a201-715301f634b8', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdcf4fd-ebd9-4e0c-9013-de435e8a2f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:03 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Volume volume-096274f0-d0c4-46d4-a201-715301f634b8 (096274f0-d0c4-46d4-a201-715301f634b8): created successfully Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdcf4fd-ebd9-4e0c-9013-de435e8a2f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:03 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (dad6bf3b-caa8-4f28-8999-badeb1987308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8c23c6e9-2a06-4bbd-aac0-c12672e0e49c tempest-CreateVolumesFromImageTest-54046104 None] Created volume successfully. Sep 25 17:20:04 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff 1073741824" returned: 0 in 0.543s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:04 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff Sep 25 17:20:04 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:04 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff" returned: 0 in 0.296s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.097s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-347382955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865d2e48-fab4-410e-9f6b-6f146631da17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43541e472b3c491dbb3a372efa3f1596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:02Z,use_quota=True,user_id='527ccf76070444478bf146e5c50a9739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Creating volume 865d2e48-fab4-410e-9f6b-6f146631da17 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:04 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed20d23c-a9c0-4325-888b-93fa3a1b5757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505fd716-d827-45ea-b4f9-4e1810c63aff', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1bb60f-4370-4e9f-88ef-2df94035218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:04 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17 1073741824 Sep 25 17:20:04 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Volume volume-505fd716-d827-45ea-b4f9-4e1810c63aff (505fd716-d827-45ea-b4f9-4e1810c63aff): created successfully Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1bb60f-4370-4e9f-88ef-2df94035218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (09e18111-3020-4858-b00b-3e91e81cdc0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-04c14b75-d663-4078-b19e-98f3ee0901e4 tempest-CreateVolumesFromImageTest-54046104 None] Created volume successfully. Sep 25 17:20:05 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17 1073741824" returned: 0 in 0.646s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:05 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17 Sep 25 17:20:05 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:05 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17" returned: 0 in 0.306s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9816058-6cde-4074-adf1-61635cde46c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865d2e48-fab4-410e-9f6b-6f146631da17', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a6cb80-0359-42f9-90af-cc3103ca0819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:05 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Volume volume-865d2e48-fab4-410e-9f6b-6f146631da17 (865d2e48-fab4-410e-9f6b-6f146631da17): created successfully Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a6cb80-0359-42f9-90af-cc3103ca0819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Flow 'volume_create_manager' (b243d71b-b634-4d60-aa88-52ee67cc810c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fd8ce3d8-dbed-4218-9dda-c0feff2e1268 tempest-CreateVolumesFromImageTest-54046104 None] Created volume successfully. Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-865d2e48-fab4-410e-9f6b-6f146631da17-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-865d2e48-fab4-410e-9f6b-6f146631da17-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-quobyte-865d2e48-fab4-410e-9f6b-6f146631da17" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-865d2e48-fab4-410e-9f6b-6f146631da17" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f600661d-f1f6-44b3-8d28-ee9260860665]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:06 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17 Sep 25 17:20:06 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:06 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17" returned: 0 in 0.507s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:06 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17 Sep 25 17:20:06 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:06 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-865d2e48-fab4-410e-9f6b-6f146631da17" returned: 0 in 0.340s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-865d2e48-fab4-410e-9f6b-6f146631da17" released by "delete_volume" :: held 0.914s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:06 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Created reservations ['f2507bec-68a2-4052-91d5-8596b2506663', 'c325640e-27b2-4623-ab06-8b4cc7d659e5', '75c5d68f-effe-4acf-967b-98fa01ae224e', '240f404e-a3ab-4522-b489-6e01efe3d6e4'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:07 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:20:07 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-505fd716-d827-45ea-b4f9-4e1810c63aff-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-505fd716-d827-45ea-b4f9-4e1810c63aff-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-quobyte-505fd716-d827-45ea-b4f9-4e1810c63aff" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-505fd716-d827-45ea-b4f9-4e1810c63aff" acquired by "delete_volume" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f8eab-285e-4001-aba5-1db0d3c8f518]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:07 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.412s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Deleted volume successfully. Sep 25 17:20:07 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff Sep 25 17:20:07 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-5ee5e460-b647-4b9b-acbe-027a22a79453 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-865d2e48-fab4-410e-9f6b-6f146631da17-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:07 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff" returned: 0 in 0.436s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:07 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff Sep 25 17:20:07 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:08 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-505fd716-d827-45ea-b4f9-4e1810c63aff" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-505fd716-d827-45ea-b4f9-4e1810c63aff" released by "delete_volume" :: held 0.887s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Created reservations ['886a22cc-aab5-4f20-8cdd-82db5a820787', '94606ed6-8137-4cc7-b499-dcf433d70a46', '328017a1-2b2e-437f-8435-a004872025c7', 'f4e3192e-d9a5-45fb-81c1-254aea7459d6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:08 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:20:08 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:08 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Deleted volume successfully. Sep 25 17:20:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-13157bae-7423-4d1d-8605-f36477d888df tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-505fd716-d827-45ea-b4f9-4e1810c63aff-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-096274f0-d0c4-46d4-a201-715301f634b8-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-096274f0-d0c4-46d4-a201-715301f634b8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-quobyte-096274f0-d0c4-46d4-a201-715301f634b8" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-096274f0-d0c4-46d4-a201-715301f634b8" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:09 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a2d5b6-82de-472b-90c5-8f868505a9c4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:09 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8 Sep 25 17:20:09 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:10 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8" returned: 0 in 0.433s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:10 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8 Sep 25 17:20:10 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:10 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-096274f0-d0c4-46d4-a201-715301f634b8" returned: 0 in 0.277s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-096274f0-d0c4-46d4-a201-715301f634b8" released by "delete_volume" :: held 0.767s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Created reservations ['20f77087-6212-4acb-a7df-f6f0f0295124', '07b6decd-4034-4482-8a88-1b9c0b10c2f8', '9b67088c-73f5-4d68-97b7-9fcc2f2eae13', '6dbaa570-160c-4327-8fb4-99f7dc061ed8'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:10 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:20:10 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-c2c3915d-982f-4e33-ba84-d5993845f76c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-c2c3915d-982f-4e33-ba84-d5993845f76c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-quobyte-c2c3915d-982f-4e33-ba84-d5993845f76c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-c2c3915d-982f-4e33-ba84-d5993845f76c" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:10 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.336s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Deleted volume successfully. Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3425bee2-b752-4a22-95a6-dd0e88d49e33]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2ac355e9-5246-41a1-a9c2-d2e665b64a43 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-096274f0-d0c4-46d4-a201-715301f634b8-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:10 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c Sep 25 17:20:10 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:11 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c" returned: 0 in 0.435s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:11 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c Sep 25 17:20:11 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:11 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c2c3915d-982f-4e33-ba84-d5993845f76c" returned: 0 in 0.304s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-c2c3915d-982f-4e33-ba84-d5993845f76c" released by "delete_volume" :: held 0.799s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Created reservations ['f8beff72-0c0f-4bc4-a3ac-47d44b47a31d', '49aff03d-713f-487a-8cc9-401a1deeb8ee', 'b25b52a3-e4d2-49ec-b5e7-ed197e603a18', '00977be6-237c-4c34-82c6-90874732f5cb'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:11 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:20:11 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-c095ba06-debc-48f9-b553-e47fe2b999d8-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-c095ba06-debc-48f9-b553-e47fe2b999d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "cinder-quobyte-c095ba06-debc-48f9-b553-e47fe2b999d8" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-c095ba06-debc-48f9-b553-e47fe2b999d8" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13a52a1-a0ad-4b67-b19b-994f9b1d654c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:12 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Deleted volume successfully. Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4abf56f8-36b6-4484-8c4c-5f8e19acdd5a tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-c2c3915d-982f-4e33-ba84-d5993845f76c-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:12 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8 Sep 25 17:20:12 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:12 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:12 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8 Sep 25 17:20:12 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:12 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c095ba06-debc-48f9-b553-e47fe2b999d8" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-quobyte-c095ba06-debc-48f9-b553-e47fe2b999d8" released by "delete_volume" :: held 0.791s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Created reservations ['2b2618d2-08fe-42ca-8338-cdd390def21e', '9cc6d023-1467-4e46-8837-62c38ee2bffb', '002e3987-97d6-4003-9046-8db921f2d2e4', 'aac32eae-3f7b-49d2-8574-bbd7bf5cf7a1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:12 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:20:12 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:13 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.314s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:13 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Deleted volume successfully. Sep 25 17:20:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a0a07def-aed6-4b58-ac41-94396c234269 tempest-CreateVolumesFromImageTest-54046104 None] Lock "cinder-c095ba06-debc-48f9-b553-e47fe2b999d8-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Flow 'volume_create_manager' (a17daf83-bacb-412d-bd27-e151534df98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099bb33a-1a40-41e7-a09e-67b7e554e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099bb33a-1a40-41e7-a09e-67b7e554e39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344848996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d068e64-be66-4648-b3fe-f8c3ef8a6adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9884fba740e40d59e1353245275531d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:18Z,use_quota=True,user_id='c9dffa5ad36c4f16aaf4918954cb68f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffd81a4-1fd7-4129-968b-f1b8ba497ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffd81a4-1fd7-4129-968b-f1b8ba497ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839b58a2-0dfb-4905-8cac-a54b2e84cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839b58a2-0dfb-4905-8cac-a54b2e84cbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d068e64-be66-4648-b3fe-f8c3ef8a6adf', 'volume_name': 'volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9ae226-91c4-4844-92b8-51ff0d52899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9ae226-91c4-4844-92b8-51ff0d52899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ea251e-2a31-47ae-a681-6d7fe0608d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:17 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Volume 2d068e64-be66-4648-b3fe-f8c3ef8a6adf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf', 'volume_size': 1} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344848996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d068e64-be66-4648-b3fe-f8c3ef8a6adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9884fba740e40d59e1353245275531d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:18Z,use_quota=True,user_id='c9dffa5ad36c4f16aaf4918954cb68f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Creating volume 2d068e64-be66-4648-b3fe-f8c3ef8a6adf {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:17 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:17 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf 1073741824 Sep 25 17:20:17 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:18 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf 1073741824" returned: 0 in 0.593s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:18 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf Sep 25 17:20:18 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:18 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf" returned: 0 in 0.331s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ea251e-2a31-47ae-a681-6d7fe0608d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b68e19f-be5c-4919-865e-124ea62bb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Volume volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf (2d068e64-be66-4648-b3fe-f8c3ef8a6adf): created successfully Sep 25 17:20:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b68e19f-be5c-4919-865e-124ea62bb03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Flow 'volume_create_manager' (a17daf83-bacb-412d-bd27-e151534df98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9b4f7692-4d30-40b7-8b79-f317e4fff35e tempest-ProjectReaderTests-211051882 None] Created volume successfully. Sep 25 17:20:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Acquiring lock "cinder-2d068e64-be66-4648-b3fe-f8c3ef8a6adf-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Lock "cinder-2d068e64-be66-4648-b3fe-f8c3ef8a6adf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Acquiring lock "cinder-quobyte-2d068e64-be66-4648-b3fe-f8c3ef8a6adf" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Lock "cinder-quobyte-2d068e64-be66-4648-b3fe-f8c3ef8a6adf" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:20 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e5ad08-cba9-4eba-8829-bceedf8834e4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:20 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf Sep 25 17:20:20 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:20 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:20 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf Sep 25 17:20:20 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:20 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2d068e64-be66-4648-b3fe-f8c3ef8a6adf" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Lock "cinder-quobyte-2d068e64-be66-4648-b3fe-f8c3ef8a6adf" released by "delete_volume" :: held 0.816s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:20 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Created reservations ['f56adea4-3ec1-4858-bec9-782162344ecb', '2757a4c0-805a-41eb-87bd-c6750dbd228b', 'c40e9e3e-7bdb-4e0e-84d4-46b2a3de97b8', '2cb5ed93-f35a-48df-979a-41bc38aeff69'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:21 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:20:21 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:21 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.296s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Deleted volume successfully. Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ee130000-37f8-4a8f-ba9b-6ab49b373639 tempest-ProjectReaderTests-211051882 None] Lock "cinder-2d068e64-be66-4648-b3fe-f8c3ef8a6adf-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Flow 'volume_create_manager' (dd416608-a7a9-445e-8dc2-cc04a09ec528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0669b76c-c41f-482b-9fc9-97bf0c1afd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0669b76c-c41f-482b-9fc9-97bf0c1afd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-379329718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34e908d-ef15-46b9-9139-4b63a1dde3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9884fba740e40d59e1353245275531d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:22Z,use_quota=True,user_id='c9dffa5ad36c4f16aaf4918954cb68f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db9a7fe-6f63-4c7b-9909-5aeb422a5b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db9a7fe-6f63-4c7b-9909-5aeb422a5b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691fc125-83b5-491e-8b08-291db8a37de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691fc125-83b5-491e-8b08-291db8a37de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34e908d-ef15-46b9-9139-4b63a1dde3f6', 'volume_name': 'volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd90f8c6-aaf9-45ed-ad3e-25dfada3c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd90f8c6-aaf9-45ed-ad3e-25dfada3c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77192132-8c7d-4269-bf8a-78d462449ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:21 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Volume a34e908d-ef15-46b9-9139-4b63a1dde3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6', 'volume_size': 1} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-379329718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34e908d-ef15-46b9-9139-4b63a1dde3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9884fba740e40d59e1353245275531d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:22Z,use_quota=True,user_id='c9dffa5ad36c4f16aaf4918954cb68f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Creating volume a34e908d-ef15-46b9-9139-4b63a1dde3f6 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:21 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:21 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 1073741824 Sep 25 17:20:21 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:22 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 1073741824" returned: 0 in 0.498s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:22 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 Sep 25 17:20:22 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:22 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:22 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77192132-8c7d-4269-bf8a-78d462449ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c30eee-c636-4e64-9cf8-66cd20d8da43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:22 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Volume volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 (a34e908d-ef15-46b9-9139-4b63a1dde3f6): created successfully Sep 25 17:20:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c30eee-c636-4e64-9cf8-66cd20d8da43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:22 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Flow 'volume_create_manager' (dd416608-a7a9-445e-8dc2-cc04a09ec528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b105974e-adf7-4781-9a5a-79133f3b687c tempest-ProjectReaderTests-211051882 None] Created volume successfully. Sep 25 17:20:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Acquiring lock "cinder-a34e908d-ef15-46b9-9139-4b63a1dde3f6-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Lock "cinder-a34e908d-ef15-46b9-9139-4b63a1dde3f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Acquiring lock "cinder-quobyte-a34e908d-ef15-46b9-9139-4b63a1dde3f6" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:20:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Lock "cinder-quobyte-a34e908d-ef15-46b9-9139-4b63a1dde3f6" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:20:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[463f4eaa-e0cf-41b8-91cf-c3f0f18c1abe]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:24 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 Sep 25 17:20:24 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:24 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Flow 'volume_create_manager' (654dc632-202e-4510-9d7a-1c7f67b415c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ce8d5c-3a79-4a86-bdf5-1bd1ee0bc495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6" returned: 0 in 0.514s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ce8d5c-3a79-4a86-bdf5-1bd1ee0bc495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-822199984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eeb8ea6-a640-4475-bf0a-d47661eb271b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8f54c6589f4f2a9a0349efb15d185f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:24Z,use_quota=True,user_id='77bc803dc192410d8f7ea522542698d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(799af656-b0e1-48cb-938a-bdcf05c6268d),volume_type_id=799af656-b0e1-48cb-938a-bdcf05c6268d)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:24 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6 Sep 25 17:20:24 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1158028-e326-4c9e-a89b-0fef9005dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1158028-e326-4c9e-a89b-0fef9005dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15fc3dd-c5b6-4e6c-9edc-c7a517c57b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15fc3dd-c5b6-4e6c-9edc-c7a517c57b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eeb8ea6-a640-4475-bf0a-d47661eb271b', 'volume_name': 'volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a9c8d5-8e39-4e5c-9078-54ded2a45d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a9c8d5-8e39-4e5c-9078-54ded2a45d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c30091-fa5a-4f6d-99b9-839fe64abbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Volume 6eeb8ea6-a640-4475-bf0a-d47661eb271b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b', 'volume_size': 1} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-822199984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eeb8ea6-a640-4475-bf0a-d47661eb271b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8f54c6589f4f2a9a0349efb15d185f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:24Z,use_quota=True,user_id='77bc803dc192410d8f7ea522542698d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(799af656-b0e1-48cb-938a-bdcf05c6268d),volume_type_id=799af656-b0e1-48cb-938a-bdcf05c6268d)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Creating volume 6eeb8ea6-a640-4475-bf0a-d47661eb271b {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:24 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:24 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b 1073741824 Sep 25 17:20:24 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:24 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a34e908d-ef15-46b9-9139-4b63a1dde3f6" returned: 0 in 0.338s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Lock "cinder-quobyte-a34e908d-ef15-46b9-9139-4b63a1dde3f6" released by "delete_volume" :: held 0.913s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Flow 'volume_create_manager' (b08e9762-08e6-45d5-bb81-416c10a70379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7842bc-4c79-44df-8815-510bd8faf3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7842bc-4c79-44df-8815-510bd8faf3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1677634330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b785581-ab87-4f99-ac16-02f63cb480f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8f54c6589f4f2a9a0349efb15d185f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:25Z,use_quota=True,user_id='77bc803dc192410d8f7ea522542698d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3af396f3-3ac5-4278-8ced-07400db9ee4b),volume_type_id=3af396f3-3ac5-4278-8ced-07400db9ee4b)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112edf5d-560f-40b0-8ba4-6143a982b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112edf5d-560f-40b0-8ba4-6143a982b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbf2d7c-39c7-48ff-a9f2-0b4069ee4d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbf2d7c-39c7-48ff-a9f2-0b4069ee4d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b785581-ab87-4f99-ac16-02f63cb480f1', 'volume_name': 'volume-3b785581-ab87-4f99-ac16-02f63cb480f1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9a02d8-774d-4d9e-9c39-fa8b2cd2fa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9a02d8-774d-4d9e-9c39-fa8b2cd2fa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac75325f-14b0-4402-9c0b-5b768b1cea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Volume 3b785581-ab87-4f99-ac16-02f63cb480f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b785581-ab87-4f99-ac16-02f63cb480f1', 'volume_size': 1} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Created reservations ['47c952b3-7bb4-494c-b017-478ef7ab0b52', '61d041ba-9fd6-47cd-a803-ac0e64d37e05', 'cac75a8c-6841-4d43-aba6-984cb8dac0c1', '930cba92-9827-4d51-8ec2-908da3caa50a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:25 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:20:25 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:25 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b 1073741824" returned: 0 in 0.650s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:25 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b Sep 25 17:20:25 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:25 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Deleted volume successfully. Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e7b513b1-8e0c-4898-a515-a59dd0dce0fe tempest-ProjectReaderTests-211051882 None] Lock "cinder-a34e908d-ef15-46b9-9139-4b63a1dde3f6-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:20:25 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b" returned: 0 in 0.341s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.564s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1677634330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b785581-ab87-4f99-ac16-02f63cb480f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8f54c6589f4f2a9a0349efb15d185f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:25Z,use_quota=True,user_id='77bc803dc192410d8f7ea522542698d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3af396f3-3ac5-4278-8ced-07400db9ee4b),volume_type_id=3af396f3-3ac5-4278-8ced-07400db9ee4b)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Creating volume 3b785581-ab87-4f99-ac16-02f63cb480f1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:25 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:20:25 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1 1073741824 Sep 25 17:20:25 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Flow 'volume_create_manager' (148d78db-cd78-40bb-8df2-152fb36b4699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bcdd2f-352f-444f-9317-3a7657e11fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c30091-fa5a-4f6d-99b9-839fe64abbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e5a2ef-5c32-4658-b2b8-f949a9b94d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bcdd2f-352f-444f-9317-3a7657e11fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1860460785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35decb48-db9b-4083-96ff-5b77c774a171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8f54c6589f4f2a9a0349efb15d185f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:26Z,use_quota=True,user_id='77bc803dc192410d8f7ea522542698d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54fd0a5e-a82e-4024-a7bf-280abe28aafd),volume_type_id=54fd0a5e-a82e-4024-a7bf-280abe28aafd)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb3d534-e7e5-4ec6-94f4-df2aa8f4cdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb3d534-e7e5-4ec6-94f4-df2aa8f4cdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1cc44c-fd91-498f-9f30-31f3b8b571a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:20:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Volume volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b (6eeb8ea6-a640-4475-bf0a-d47661eb271b): created successfully Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e5a2ef-5c32-4658-b2b8-f949a9b94d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Flow 'volume_create_manager' (654dc632-202e-4510-9d7a-1c7f67b415c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2abaa0f4-d06f-4a38-b614-6871f2a308c0 tempest-TestInstancesWithCinderVolumes-616215844 None] Created volume successfully. Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1cc44c-fd91-498f-9f30-31f3b8b571a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35decb48-db9b-4083-96ff-5b77c774a171', 'volume_name': 'volume-35decb48-db9b-4083-96ff-5b77c774a171', 'volume_size': 1, 'image_id': 'deeacb9e-1b51-48ed-b88c-771f631d5be9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/deeacb9e-1b51-48ed-b88c-771f631d5be9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1481603079', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f8f54c6589f4f2a9a0349efb15d185f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'deeacb9e-1b51-48ed-b88c-771f631d5be9', 'created_at': datetime.datetime(2026, 9, 25, 15, 20, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 20, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/deeacb9e-1b51-48ed-b88c-771f631d5be9/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8277521-f6ea-45c6-b74d-16d8261d0847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8277521-f6ea-45c6-b74d-16d8261d0847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6c8c62-0292-4ae5-b8c7-3024f5afb0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:26 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Volume 35decb48-db9b-4083-96ff-5b77c774a171: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35decb48-db9b-4083-96ff-5b77c774a171', 'volume_size': 1, 'image_id': 'deeacb9e-1b51-48ed-b88c-771f631d5be9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/deeacb9e-1b51-48ed-b88c-771f631d5be9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1481603079', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f8f54c6589f4f2a9a0349efb15d185f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'deeacb9e-1b51-48ed-b88c-771f631d5be9', 'created_at': datetime.datetime(2026, 9, 25, 15, 20, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 20, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/deeacb9e-1b51-48ed-b88c-771f631d5be9/file', 'properties': {}}, 'image_service': } Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Trying to clone 35decb48-db9b-4083-96ff-5b77c774a171 from image deeacb9e-1b51-48ed-b88c-771f631d5be9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/deeacb9e-1b51-48ed-b88c-771f631d5be9', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:20:26 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1 1073741824" returned: 0 in 0.589s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:26 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1 Sep 25 17:20:26 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:26 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac75325f-14b0-4402-9c0b-5b768b1cea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b785581-ab87-4f99-ac16-02f63cb480f1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405ad6d9-0564-47e0-a8db-6caa3ca3cfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:26 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Volume volume-3b785581-ab87-4f99-ac16-02f63cb480f1 (3b785581-ab87-4f99-ac16-02f63cb480f1): created successfully Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405ad6d9-0564-47e0-a8db-6caa3ca3cfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Flow 'volume_create_manager' (b08e9762-08e6-45d5-bb81-416c10a70379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d7381cdc-dbe5-4ede-819a-a9930a7b96f9 tempest-TestInstancesWithCinderVolumes-616215844 None] Created volume successfully. Sep 25 17:20:29 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD, size 20.69 MB, duration 3.81 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:20:29 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Image download 20.69 MB at 5.43 MB/s Sep 25 17:20:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02a8aaf-9aa9-405f-9720-7e2011a3c0e6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:30 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD Sep 25 17:20:30 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:30 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Temporary image deeacb9e-1b51-48ed-b88c-771f631d5be9 is fetched for user 77bc803dc192410d8f7ea522542698d1. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ab35b-7ffe-4f1c-b507-97aa24298d00]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:30 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD Sep 25 17:20:30 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:30 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1860460785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35decb48-db9b-4083-96ff-5b77c774a171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8f54c6589f4f2a9a0349efb15d185f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:20:26Z,use_quota=True,user_id='77bc803dc192410d8f7ea522542698d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54fd0a5e-a82e-4024-a7bf-280abe28aafd),volume_type_id=54fd0a5e-a82e-4024-a7bf-280abe28aafd)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Creating volume 35decb48-db9b-4083-96ff-5b77c774a171 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:20:30 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:20:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:30 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 1073741824 Sep 25 17:20:30 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:31 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 1073741824" returned: 0 in 0.521s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:31 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 Sep 25 17:20:31 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:31 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:20:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:31 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Attempting download of deeacb9e-1b51-48ed-b88c-771f631d5be9 ((None, [{'url': 'file:///opt/stack/data/glance/images/deeacb9e-1b51-48ed-b88c-771f631d5be9', 'metadata': {}}])) to volume 35decb48-db9b-4083-96ff-5b77c774a171. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:20:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a7c98a-5e51-4798-8bef-5e97c988658d]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_deeacb9e-1b51-48ed-b88c-771f631d5be9___w4qqkx {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:31 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_deeacb9e-1b51-48ed-b88c-771f631d5be9___w4qqkx Sep 25 17:20:31 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:32 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_deeacb9e-1b51-48ed-b88c-771f631d5be9___w4qqkx" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_deeacb9e-1b51-48ed-b88c-771f631d5be9___w4qqkx {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:32 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_deeacb9e-1b51-48ed-b88c-771f631d5be9___w4qqkx Sep 25 17:20:32 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:32 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_deeacb9e-1b51-48ed-b88c-771f631d5be9___w4qqkx" returned: 1 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_deeacb9e-1b51-48ed-b88c-771f631d5be9___w4qqkx' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:20:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[369e0300-45f2-476d-831b-d056adcdf53f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:20:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:32 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD Sep 25 17:20:32 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:32 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:32 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] deeacb9e-1b51-48ed-b88c-771f631d5be9 was qcow2, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:20:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:32 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 Sep 25 17:20:32 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:34 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171" returned: 0 in 1.989s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:34 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_deeacb9e-1b51-48ed-b88c-771f631d5be9_443cc23zdevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:20:34 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Converted 112.00 MB image at 56.28 MB/s Sep 25 17:20:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:34 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 1G Sep 25 17:20:34 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:35 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 1G" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Downloaded image deeacb9e-1b51-48ed-b88c-771f631d5be9 ((None, [{'url': 'file:///opt/stack/data/glance/images/deeacb9e-1b51-48ed-b88c-771f631d5be9', 'metadata': {}}])) to volume 35decb48-db9b-4083-96ff-5b77c774a171 successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Temporary image deeacb9e-1b51-48ed-b88c-771f631d5be9 for user 77bc803dc192410d8f7ea522542698d1 is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Marking volume 35decb48-db9b-4083-96ff-5b77c774a171 as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Copying metadata from image deeacb9e-1b51-48ed-b88c-771f631d5be9 to 35decb48-db9b-4083-96ff-5b77c774a171. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Creating volume glance metadata for volume 35decb48-db9b-4083-96ff-5b77c774a171 backed by image deeacb9e-1b51-48ed-b88c-771f631d5be9 with: {'image_id': 'deeacb9e-1b51-48ed-b88c-771f631d5be9', 'image_name': 'tempest-scenario-img--1481603079', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6c8c62-0292-4ae5-b8c7-3024f5afb0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35decb48-db9b-4083-96ff-5b77c774a171', 'volume_size': 1, 'image_id': 'deeacb9e-1b51-48ed-b88c-771f631d5be9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/deeacb9e-1b51-48ed-b88c-771f631d5be9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1481603079', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f8f54c6589f4f2a9a0349efb15d185f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'deeacb9e-1b51-48ed-b88c-771f631d5be9', 'created_at': datetime.datetime(2026, 9, 25, 15, 20, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 20, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/deeacb9e-1b51-48ed-b88c-771f631d5be9/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4800ea-630b-4bab-b13b-e60320e4bbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:20:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Volume volume-35decb48-db9b-4083-96ff-5b77c774a171 (35decb48-db9b-4083-96ff-5b77c774a171): created successfully Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4800ea-630b-4bab-b13b-e60320e4bbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:20:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Flow 'volume_create_manager' (148d78db-cd78-40bb-8df2-152fb36b4699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:20:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b12b9cf8-1b0f-4828-847a-c944c171e93b tempest-TestInstancesWithCinderVolumes-616215844 None] Created volume successfully. Sep 25 17:20:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-f6f94122-b879-4957-9f72-4ecd4cf1ff8e req-5ed4e0eb-b402-4673-b953-0be30a05c492 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-f6f94122-b879-4957-9f72-4ecd4cf1ff8e req-5ed4e0eb-b402-4673-b953-0be30a05c492 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-f6f94122-b879-4957-9f72-4ecd4cf1ff8e req-5ed4e0eb-b402-4673-b953-0be30a05c492 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-f6f94122-b879-4957-9f72-4ecd4cf1ff8e req-5ed4e0eb-b402-4673-b953-0be30a05c492 tempest-TestInstancesWithCinderVolumes-616215844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-35decb48-db9b-4083-96ff-5b77c774a171', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51b0f2f2-f2e6-480a-84e5-7bcd27ed6028', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:20:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-f6f94122-b879-4957-9f72-4ecd4cf1ff8e req-5ed4e0eb-b402-4673-b953-0be30a05c492 tempest-TestInstancesWithCinderVolumes-616215844 None] attachment_update completed successfully. Sep 25 17:20:48 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=83,cinder:INSERT=33,cinder:UPDATE=101,cinder:DELETE=10 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:20:48 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=120,cinder:SELECT=79,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:20:56 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:20:56 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:20:56 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:20:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:21:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-c67f16fa-5ce5-4f58-844e-16d22442bd57 req-0d5a306d-68dc-4c90-9064-89fc17bb39c6 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-c67f16fa-5ce5-4f58-844e-16d22442bd57 req-0d5a306d-68dc-4c90-9064-89fc17bb39c6 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-c67f16fa-5ce5-4f58-844e-16d22442bd57 req-0d5a306d-68dc-4c90-9064-89fc17bb39c6 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-c67f16fa-5ce5-4f58-844e-16d22442bd57 req-0d5a306d-68dc-4c90-9064-89fc17bb39c6 tempest-TestInstancesWithCinderVolumes-616215844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74ae373a-5fcb-45af-8092-131696c0b6de', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:21:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-c67f16fa-5ce5-4f58-844e-16d22442bd57 req-0d5a306d-68dc-4c90-9064-89fc17bb39c6 tempest-TestInstancesWithCinderVolumes-616215844 None] attachment_update completed successfully. Sep 25 17:21:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-58276128-ba7e-4f99-ada4-39625730a12f req-122b4445-eaa3-491c-9283-b6239d1e277d tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-58276128-ba7e-4f99-ada4-39625730a12f req-122b4445-eaa3-491c-9283-b6239d1e277d tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-58276128-ba7e-4f99-ada4-39625730a12f req-122b4445-eaa3-491c-9283-b6239d1e277d tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:13 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-58276128-ba7e-4f99-ada4-39625730a12f req-122b4445-eaa3-491c-9283-b6239d1e277d tempest-TestInstancesWithCinderVolumes-616215844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-3b785581-ab87-4f99-ac16-02f63cb480f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0cd792c-8d6f-4812-97b0-e88de379534a', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:21:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-58276128-ba7e-4f99-ada4-39625730a12f req-122b4445-eaa3-491c-9283-b6239d1e277d tempest-TestInstancesWithCinderVolumes-616215844 None] attachment_update completed successfully. Sep 25 17:21:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-57c18dc0-f8ca-422a-80ca-34f99f28d735 req-e7f63679-5702-4c8e-962a-8d68d025b667 tempest-TestInstancesWithCinderVolumes-616215844 None] Terminate volume connection completed successfully. Sep 25 17:21:19 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-57c18dc0-f8ca-422a-80ca-34f99f28d735 req-e7f63679-5702-4c8e-962a-8d68d025b667 tempest-TestInstancesWithCinderVolumes-616215844 None] Deleting attachment 74ae373a-5fcb-45af-8092-131696c0b6de. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:21:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "cinder-6eeb8ea6-a640-4475-bf0a-d47661eb271b-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-6eeb8ea6-a640-4475-bf0a-d47661eb271b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "cinder-quobyte-6eeb8ea6-a640-4475-bf0a-d47661eb271b" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-quobyte-6eeb8ea6-a640-4475-bf0a-d47661eb271b" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:20 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[87844542-4489-4de8-825f-d43d87552946]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:20 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b Sep 25 17:21:20 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:21 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:21 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b Sep 25 17:21:21 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:21 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6eeb8ea6-a640-4475-bf0a-d47661eb271b" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-quobyte-6eeb8ea6-a640-4475-bf0a-d47661eb271b" released by "delete_volume" :: held 0.773s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:21 devstack cinder-volume[87232]: WARNING cinder.quota [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1319247069-1964697779 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1319247069-1964697779, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:21:21 devstack cinder-volume[87232]: WARNING cinder.quota [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1319247069-1964697779 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1319247069-1964697779, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Created reservations ['fb1ed239-8778-4c6c-b14c-a3c034c4c46a', '9dd4c91f-6ae6-4408-97c2-1a3485867dc3', '869006df-21a8-4b1a-8cea-49b086fe6162', 'a8b063d3-4c41-424c-91d1-29874cfdff15'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:21 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:21:21 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:21 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.275s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:21:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Deleted volume successfully. Sep 25 17:21:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-386a0335-f542-4a3f-8da2-9f9c27c018d2 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-6eeb8ea6-a640-4475-bf0a-d47661eb271b-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-3a6f45fa-21ef-4f4d-bbe4-2fd840ab2468 req-d2e12d02-0ee3-4a2e-b722-6e9599d7097a tempest-TestInstancesWithCinderVolumes-616215844 None] Terminate volume connection completed successfully. Sep 25 17:21:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-3a6f45fa-21ef-4f4d-bbe4-2fd840ab2468 req-d2e12d02-0ee3-4a2e-b722-6e9599d7097a tempest-TestInstancesWithCinderVolumes-616215844 None] Deleting attachment c0cd792c-8d6f-4812-97b0-e88de379534a. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:21:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "cinder-3b785581-ab87-4f99-ac16-02f63cb480f1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-3b785581-ab87-4f99-ac16-02f63cb480f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "cinder-quobyte-3b785581-ab87-4f99-ac16-02f63cb480f1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:25 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-quobyte-3b785581-ab87-4f99-ac16-02f63cb480f1" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:25 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c0d3f-77e9-4ce0-b1cc-276263687925]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:25 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1 Sep 25 17:21:25 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:25 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1" returned: 0 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:25 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1 Sep 25 17:21:25 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:26 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3b785581-ab87-4f99-ac16-02f63cb480f1" returned: 0 in 0.292s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-quobyte-3b785581-ab87-4f99-ac16-02f63cb480f1" released by "delete_volume" :: held 0.802s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:26 devstack cinder-volume[87232]: WARNING cinder.quota [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1479722310-1824898986 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1479722310-1824898986, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:21:26 devstack cinder-volume[87232]: WARNING cinder.quota [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1479722310-1824898986 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1479722310-1824898986, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Created reservations ['68f44474-177e-4cfe-99de-ed0e19adaa73', '0155891a-95bf-4703-8e36-cc265c2e44fd', 'c0af345d-4114-46b1-b9c6-08437bb03a2c', '1e5f58a2-2fd2-4f1a-9424-e9b7b71ed926'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:26 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:21:26 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:26 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:21:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Deleted volume successfully. Sep 25 17:21:26 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7caee484-9d5e-4157-9fef-23b4e52edbd9 tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-3b785581-ab87-4f99-ac16-02f63cb480f1-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-1f44f099-32bb-4dd2-8930-44d02fe480f2 req-8d84d389-f6f6-4014-a7e5-df4470620140 tempest-TestInstancesWithCinderVolumes-616215844 None] Terminate volume connection completed successfully. Sep 25 17:21:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-1f44f099-32bb-4dd2-8930-44d02fe480f2 req-8d84d389-f6f6-4014-a7e5-df4470620140 tempest-TestInstancesWithCinderVolumes-616215844 None] Deleting attachment 51b0f2f2-f2e6-480a-84e5-7bcd27ed6028. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:21:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "cinder-35decb48-db9b-4083-96ff-5b77c774a171-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-35decb48-db9b-4083-96ff-5b77c774a171-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "cinder-quobyte-35decb48-db9b-4083-96ff-5b77c774a171" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:21:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-quobyte-35decb48-db9b-4083-96ff-5b77c774a171" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:21:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9dc982-49e3-4277-b781-53c8d7eb3baf]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:21:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:30 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 Sep 25 17:21:30 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:31 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171" returned: 0 in 0.452s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:31 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171 Sep 25 17:21:31 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:31 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-35decb48-db9b-4083-96ff-5b77c774a171" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-quobyte-35decb48-db9b-4083-96ff-5b77c774a171" released by "delete_volume" :: held 0.754s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:31 devstack cinder-volume[87232]: WARNING cinder.quota [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744757712-1120338217 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744757712-1120338217, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:21:31 devstack cinder-volume[87232]: WARNING cinder.quota [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744757712-1120338217 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-744757712-1120338217, it is now deprecated. Please use the default quota class for default quota. Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Created reservations ['ea91a518-9a1e-41d3-8dae-4b5e732448c3', '9043ca4b-17d5-4b62-a32f-84c101fb5109', '5a128682-0ee3-4ca5-8cf0-e27b40a1261d', 'b903eb06-85ff-4b88-9bd7-b42ebc421dfa'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:31 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:21:31 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:31 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:21:31 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Deleted volume successfully. Sep 25 17:21:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a7b1bb9f-342e-4ea2-86ab-40b2fb3a08cd tempest-TestInstancesWithCinderVolumes-616215844 None] Lock "cinder-35decb48-db9b-4083-96ff-5b77c774a171-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:21:41 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=30,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:21:41 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=32,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:21:56 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:21:56 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:21:56 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.249s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:21:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:22:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:22:31 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Flow 'volume_create_manager' (72e5764e-6451-40ff-8f4e-69a3062f22df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd964baf-3475-48b0-a947-7283223675cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd964baf-3475-48b0-a947-7283223675cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-707123636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffa49bc-4d53-4783-a732-c1bcecf40a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a699c9d1ee6a453aad6e2becd7578627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:44Z,use_quota=True,user_id='225dca99e7004b3892ad0673f33b2028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecbd22e-2fb6-4303-8e3a-6d7aad43e61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecbd22e-2fb6-4303-8e3a-6d7aad43e61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a204be-d0bd-402c-9a71-c0b578b7bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a204be-d0bd-402c-9a71-c0b578b7bdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffa49bc-4d53-4783-a732-c1bcecf40a14', 'volume_name': 'volume-cffa49bc-4d53-4783-a732-c1bcecf40a14', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949f587e-74b0-44ef-9ec0-e4d2a9a41ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949f587e-74b0-44ef-9ec0-e4d2a9a41ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a019bc1-9312-4842-9b0e-fcbce1cddfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:44 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Volume cffa49bc-4d53-4783-a732-c1bcecf40a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffa49bc-4d53-4783-a732-c1bcecf40a14', 'volume_size': 1} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-707123636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffa49bc-4d53-4783-a732-c1bcecf40a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a699c9d1ee6a453aad6e2becd7578627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:22:44Z,use_quota=True,user_id='225dca99e7004b3892ad0673f33b2028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Creating volume cffa49bc-4d53-4783-a732-c1bcecf40a14 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:22:44 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:44 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 1073741824 Sep 25 17:22:44 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:44 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 1073741824" returned: 0 in 0.467s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:44 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 Sep 25 17:22:44 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:45 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14" returned: 0 in 0.288s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:22:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a019bc1-9312-4842-9b0e-fcbce1cddfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffa49bc-4d53-4783-a732-c1bcecf40a14', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6c9916-656f-47c2-b97c-d30df86f5a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:22:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Volume volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 (cffa49bc-4d53-4783-a732-c1bcecf40a14): created successfully Sep 25 17:22:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6c9916-656f-47c2-b97c-d30df86f5a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:22:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Flow 'volume_create_manager' (72e5764e-6451-40ff-8f4e-69a3062f22df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:22:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e52e9cd0-3e7b-4536-8e00-5034c1dbbff0 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Created volume successfully. Sep 25 17:22:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-d6a1cca8-1fbd-433b-9f8b-c863a0844542 req-15a935a4-a2f1-429c-9a35-7447b73450ce tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-d6a1cca8-1fbd-433b-9f8b-c863a0844542 req-15a935a4-a2f1-429c-9a35-7447b73450ce tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [req-d6a1cca8-1fbd-433b-9f8b-c863a0844542 req-15a935a4-a2f1-429c-9a35-7447b73450ce tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-d6a1cca8-1fbd-433b-9f8b-c863a0844542 req-15a935a4-a2f1-429c-9a35-7447b73450ce tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b', 'name': 'volume-cffa49bc-4d53-4783-a732-c1bcecf40a14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '700c444f-2df9-4b0c-93e2-e7f67cadf4d7', 'enforce_multipath': True} {{(pid=87232) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 17:22:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-d6a1cca8-1fbd-433b-9f8b-c863a0844542 req-15a935a4-a2f1-429c-9a35-7447b73450ce tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] attachment_update completed successfully. Sep 25 17:22:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [req-5311e23b-7a98-408f-8856-e6949fcc729b req-257ed6fc-bdf5-4070-8921-f25909c6b2b2 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Terminate volume connection completed successfully. Sep 25 17:22:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [req-5311e23b-7a98-408f-8856-e6949fcc729b req-257ed6fc-bdf5-4070-8921-f25909c6b2b2 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Deleting attachment 700c444f-2df9-4b0c-93e2-e7f67cadf4d7. {{(pid=87232) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Acquiring lock "cinder-cffa49bc-4d53-4783-a732-c1bcecf40a14-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "cinder-cffa49bc-4d53-4783-a732-c1bcecf40a14-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Acquiring lock "cinder-quobyte-cffa49bc-4d53-4783-a732-c1bcecf40a14" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "cinder-quobyte-cffa49bc-4d53-4783-a732-c1bcecf40a14" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a4d990-8695-41da-91eb-18b9d02f1a69]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:51 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 Sep 25 17:22:51 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:51 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14" returned: 0 in 0.412s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:51 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14 Sep 25 17:22:51 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:51 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-cffa49bc-4d53-4783-a732-c1bcecf40a14" returned: 0 in 0.261s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "cinder-quobyte-cffa49bc-4d53-4783-a732-c1bcecf40a14" released by "delete_volume" :: held 0.715s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Created reservations ['2339c433-529f-4cd7-bd85-fe728088eb91', '6d7944c6-6807-4f2f-9cdb-8e6fa4a8c281', '8c30b598-2415-4647-a339-de3e9c8fc1f2', 'a931d669-a106-4834-a607-14c1764111be'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:52 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:22:52 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:52 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.246s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:52 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Deleted volume successfully. Sep 25 17:22:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-dfb9d29a-b743-4290-9587-e9039afa12d4 tempest-TestServerVolumeAttachScenarioOldVersion-1545859598 None] Lock "cinder-cffa49bc-4d53-4783-a732-c1bcecf40a14-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:22:56 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:22:56 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:22:56 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.291s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:22:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:23:01 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=15,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:23:02 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Flow 'volume_create_manager' (77dc4277-bd5c-468d-a0d8-fa8b4d14c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d635df3-b28f-49b3-860d-3355d10d4912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d635df3-b28f-49b3-860d-3355d10d4912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1571665544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22bc6f9a-7244-474b-8c7a-573cd9844e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9082c6ff3f04eb693e8427593bc2d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:40Z,use_quota=True,user_id='dc4a8f5807e44e76adf9a01a18a2dae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c123ab-a487-45ba-895c-3b9d8bf2d493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c123ab-a487-45ba-895c-3b9d8bf2d493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5b1da4-7dd2-4619-b0c0-86fba9936535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5b1da4-7dd2-4619-b0c0-86fba9936535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22bc6f9a-7244-474b-8c7a-573cd9844e61', 'volume_name': 'volume-22bc6f9a-7244-474b-8c7a-573cd9844e61', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b818d650-1d97-4a86-9735-512a67954354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b818d650-1d97-4a86-9735-512a67954354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d310096-baf0-40fa-a4e8-7b2eb185afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Volume 22bc6f9a-7244-474b-8c7a-573cd9844e61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22bc6f9a-7244-474b-8c7a-573cd9844e61', 'volume_size': 1} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1571665544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22bc6f9a-7244-474b-8c7a-573cd9844e61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9082c6ff3f04eb693e8427593bc2d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:40Z,use_quota=True,user_id='dc4a8f5807e44e76adf9a01a18a2dae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Creating volume 22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:40 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:23:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:40 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 1073741824 Sep 25 17:23:40 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:41 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 1073741824" returned: 0 in 0.508s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:41 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 Sep 25 17:23:41 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:41 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61" returned: 0 in 0.291s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:23:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d310096-baf0-40fa-a4e8-7b2eb185afc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22bc6f9a-7244-474b-8c7a-573cd9844e61', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c276f0a4-802a-4fc9-ae5a-3d86f3adfe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Volume volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 (22bc6f9a-7244-474b-8c7a-573cd9844e61): created successfully Sep 25 17:23:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c276f0a4-802a-4fc9-ae5a-3d86f3adfe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Flow 'volume_create_manager' (77dc4277-bd5c-468d-a0d8-fa8b4d14c283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dfeda036-545e-4fab-a3c2-863ddc46afb2 tempest-SnapshotDependencyTests-299771553 None] Created volume successfully. Sep 25 17:23:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Creating offline snapshot e841547e-5df7-47ba-b62a-345e0628bb9f of volume 22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:23:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aafb4c-c23c-4fa2-855b-af9b9040ec22]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:43 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 Sep 25 17:23:43 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:43 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:43 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f 1G Sep 25 17:23:43 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:43 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f 1G" returned: 0 in 0.411s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:43 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f Sep 25 17:23:43 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:44 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f" returned: 0 in 0.290s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:44 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f is being set with open permissions: ugo+rw Sep 25 17:23:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:44 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f Sep 25 17:23:44 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:44 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:44 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.info Sep 25 17:23:44 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:44 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.info" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:44 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.info is being set with open permissions: ugo+rw Sep 25 17:23:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:44 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.info Sep 25 17:23:44 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:44 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.info" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c6d8e58c-9e5c-4f4e-91ae-8bd90820a1d7 tempest-SnapshotDependencyTests-299771553 None] Create snapshot completed successfully Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Flow 'volume_create_manager' (6bffae5c-62f6-4e39-b697-b906ee4d0b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6c1271-1191-441b-92bb-eb4158bca1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6c1271-1191-441b-92bb-eb4158bca1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c317cb08-2373-41d6-b334-d96669ba2021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9082c6ff3f04eb693e8427593bc2d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e841547e-5df7-47ba-b62a-345e0628bb9f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:23:47Z,use_quota=True,user_id='dc4a8f5807e44e76adf9a01a18a2dae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bf66e5-9dc3-4e0a-b60b-97b16433bb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bf66e5-9dc3-4e0a-b60b-97b16433bb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47376086-1909-4474-888d-8340d3bc6c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47376086-1909-4474-888d-8340d3bc6c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c317cb08-2373-41d6-b334-d96669ba2021', 'volume_name': 'volume-c317cb08-2373-41d6-b334-d96669ba2021', 'volume_size': 1, 'snapshot_id': 'e841547e-5df7-47ba-b62a-345e0628bb9f'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb8a248-6376-4d3c-9011-2ca20b9e1b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb8a248-6376-4d3c-9011-2ca20b9e1b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8407d4c-8201-4321-a768-09aa22b004ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Volume c317cb08-2373-41d6-b334-d96669ba2021: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c317cb08-2373-41d6-b334-d96669ba2021', 'volume_size': 1, 'snapshot_id': 'e841547e-5df7-47ba-b62a-345e0628bb9f'} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "cinder-quobyte-e841547e-5df7-47ba-b62a-345e0628bb9f-c317cb08-2373-41d6-b334-d96669ba2021" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-e841547e-5df7-47ba-b62a-345e0628bb9f-c317cb08-2373-41d6-b334-d96669ba2021" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Creating volume c317cb08-2373-41d6-b334-d96669ba2021 from snapshot e841547e-5df7-47ba-b62a-345e0628bb9f {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "cinder-quobyte-c317cb08-2373-41d6-b334-d96669ba2021" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-c317cb08-2373-41d6-b334-d96669ba2021" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] snapshot: e841547e-5df7-47ba-b62a-345e0628bb9f, volume: c317cb08-2373-41d6-b334-d96669ba2021, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[205b6e87-3515-45f2-ab2a-20cd2759443e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:47 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f Sep 25 17:23:47 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:47 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22bc6f9a-7244-474b-8c7a-573cd9844e61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:23:47 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a9fdcf-f97a-467f-8473-614f010c219f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:47 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 Sep 25 17:23:47 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:47 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:23:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:23:47 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:23:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:47 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 Sep 25 17:23:47 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:54 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021" returned: 0 in 6.346s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:23:54 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Converted 1024.00 MB image at 161.32 MB/s Sep 25 17:23:54 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 is being set with open permissions: ugo+rw Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:54 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 Sep 25 17:23:54 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:54 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-c317cb08-2373-41d6-b334-d96669ba2021" released by "_copy_volume_from_snapshot" :: held 7.494s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-e841547e-5df7-47ba-b62a-345e0628bb9f-c317cb08-2373-41d6-b334-d96669ba2021" released by "_create_volume_from_snapshot" :: held 7.570s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.589s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8407d4c-8201-4321-a768-09aa22b004ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c317cb08-2373-41d6-b334-d96669ba2021', 'volume_size': 1, 'snapshot_id': 'e841547e-5df7-47ba-b62a-345e0628bb9f'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3ce55b-98c1-4897-816c-e57d8c4816cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:23:54 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Volume volume-c317cb08-2373-41d6-b334-d96669ba2021 (c317cb08-2373-41d6-b334-d96669ba2021): created successfully Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3ce55b-98c1-4897-816c-e57d8c4816cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:23:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Flow 'volume_create_manager' (6bffae5c-62f6-4e39-b697-b906ee4d0b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:23:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e4403d4b-1522-4bcc-8ce2-611c70cb8898 tempest-SnapshotDependencyTests-299771553 None] Created volume successfully. Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "cinder-e841547e-5df7-47ba-b62a-345e0628bb9f-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-e841547e-5df7-47ba-b62a-345e0628bb9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "cinder-quobyte-22bc6f9a-7244-474b-8c7a-573cd9844e61" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-22bc6f9a-7244-474b-8c7a-573cd9844e61" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "cinder-quobyte-e841547e-5df7-47ba-b62a-345e0628bb9f" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-e841547e-5df7-47ba-b62a-345e0628bb9f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Deleting offline snapshot e841547e-5df7-47ba-b62a-345e0628bb9f of volume 22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] snapshot_file for this snap is: volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[24083a1b-7ce9-47e8-accd-aea4bc263988]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:55 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f Sep 25 17:23:55 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:55 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f" returned: 0 in 0.405s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22bc6f9a-7244-474b-8c7a-573cd9844e61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2b43d1-455b-46a9-bc8f-afd249dbbbb3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:56 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 Sep 25 17:23:56 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:56 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:23:56 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:56 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.279s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:23:56 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61" returned: 0 in 0.604s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:56 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f Sep 25 17:23:56 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:56 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:56 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f Sep 25 17:23:56 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:57 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61.e841547e-5df7-47ba-b62a-345e0628bb9f" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-e841547e-5df7-47ba-b62a-345e0628bb9f" released by "_delete_snapshot" :: held 1.772s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-22bc6f9a-7244-474b-8c7a-573cd9844e61" released by "delete_snapshot" :: held 1.794s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Created reservations ['cf6556b2-2649-4a65-8870-fe572afcd95c', '0fd7a50f-63cf-4596-949c-a1bb9fddfd11', '08979aae-f814-4664-8c6e-9017b405e4dc', 'cf83431c-28c6-41f4-b685-d8a47a3e5555'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:23:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Delete snapshot completed successfully. Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7d739dda-c43a-4f6c-a79a-d64e8e5209bd tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-e841547e-5df7-47ba-b62a-345e0628bb9f-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "cinder-22bc6f9a-7244-474b-8c7a-573cd9844e61-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-22bc6f9a-7244-474b-8c7a-573cd9844e61-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "cinder-quobyte-22bc6f9a-7244-474b-8c7a-573cd9844e61" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-22bc6f9a-7244-474b-8c7a-573cd9844e61" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b62453-e501-4dcb-a044-e8bcd21e111b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:57 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 Sep 25 17:23:57 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:58 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:58 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61 Sep 25 17:23:58 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:58 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-22bc6f9a-7244-474b-8c7a-573cd9844e61" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-22bc6f9a-7244-474b-8c7a-573cd9844e61" released by "delete_volume" :: held 0.713s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Created reservations ['08647559-b4dd-4ea7-a315-320874ac8140', 'e6a78506-0a1c-4dfe-a08d-6890176ecf6a', '6c08fa91-8a99-4445-9d95-9d1a5d8d8a0f', '10f0770d-0844-4693-ab04-98f1ed9e85e6'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:58 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:23:58 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:58 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.272s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:23:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Deleted volume successfully. Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "cinder-c317cb08-2373-41d6-b334-d96669ba2021-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-c317cb08-2373-41d6-b334-d96669ba2021-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c33e42eb-5fa7-485c-8712-d9e1ecf0f675 tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-22bc6f9a-7244-474b-8c7a-573cd9844e61-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "cinder-quobyte-c317cb08-2373-41d6-b334-d96669ba2021" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-c317cb08-2373-41d6-b334-d96669ba2021" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d9b6ff-0766-4ff3-8f28-7c8384af4c42]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:23:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:59 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 Sep 25 17:23:59 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:59 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:59 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021 Sep 25 17:23:59 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:23:59 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c317cb08-2373-41d6-b334-d96669ba2021" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-quobyte-c317cb08-2373-41d6-b334-d96669ba2021" released by "delete_volume" :: held 0.729s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Created reservations ['e5d96ecd-ee24-43d3-97e5-a9e82a38d250', 'bf0f1159-5648-40fd-bc58-f40d285591f2', '4196f2ea-b88c-4b71-a47e-f3927a7adb0c', '73646728-55af-4613-9763-03d22eb6b1aa'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:23:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:23:59 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:23:59 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:00 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.307s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:00 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Deleted volume successfully. Sep 25 17:24:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cccb746f-794c-40db-9e43-64229747311d tempest-SnapshotDependencyTests-299771553 None] Lock "cinder-c317cb08-2373-41d6-b334-d96669ba2021-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:09 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=21,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:24:10 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=28,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (e617dd2c-0591-4e85-80d2-69bad1f056ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6cb33a-17d6-48bb-b380-c456da008df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6cb33a-17d6-48bb-b380-c456da008df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137483348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ba1b4e-8b8f-4a36-8b63-1f491337eca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:23Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dca76ce-b629-4154-8493-5898ac6481ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dca76ce-b629-4154-8493-5898ac6481ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88ccc6f-d8ea-473c-a58c-401c1ff46d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88ccc6f-d8ea-473c-a58c-401c1ff46d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ba1b4e-8b8f-4a36-8b63-1f491337eca4', 'volume_name': 'volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28662f92-1c51-4462-b761-9435790d49f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28662f92-1c51-4462-b761-9435790d49f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cad4bb-97d7-4cd3-8182-416696b3351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Volume 54ba1b4e-8b8f-4a36-8b63-1f491337eca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4', 'volume_size': 1} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137483348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ba1b4e-8b8f-4a36-8b63-1f491337eca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:23Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Creating volume 54ba1b4e-8b8f-4a36-8b63-1f491337eca4 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:23 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:23 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 1073741824 Sep 25 17:24:23 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (8cf1e07c-200d-4787-bc54-162c3ecde6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399c9961-b33a-4345-beae-f11d386e9c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399c9961-b33a-4345-beae-f11d386e9c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529461456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c5cb6e-386a-40af-8739-0f04fa8fd84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:24Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90c55cb-95e6-4b48-8c41-9ec6c6e1f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90c55cb-95e6-4b48-8c41-9ec6c6e1f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dce166-a891-4ce9-9dc0-1abaafb88dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1dce166-a891-4ce9-9dc0-1abaafb88dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c5cb6e-386a-40af-8739-0f04fa8fd84c', 'volume_name': 'volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff2914f-89a4-4b38-95f2-566efcd77ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff2914f-89a4-4b38-95f2-566efcd77ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f0c7d0-0ca5-4923-a9b8-1e8ac85efbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:23 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume 02c5cb6e-386a-40af-8739-0f04fa8fd84c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c', 'volume_size': 1} Sep 25 17:24:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (51d4ff87-48c6-4ef3-a402-9aee8925807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0a6841-514a-425f-91e6-0d02691988c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0a6841-514a-425f-91e6-0d02691988c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209950071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48ab538-b9fa-44e9-938f-b2837146160c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:24Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fc07ac-9e18-452c-a784-41ad361c7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fc07ac-9e18-452c-a784-41ad361c7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c502c7-96cc-4972-b66c-6ed64c33956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c502c7-96cc-4972-b66c-6ed64c33956d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48ab538-b9fa-44e9-938f-b2837146160c', 'volume_name': 'volume-b48ab538-b9fa-44e9-938f-b2837146160c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854a8ed8-6349-4492-a96a-a011d3b44f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854a8ed8-6349-4492-a96a-a011d3b44f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fae59b0-89c7-400b-99bf-1514565c75b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Volume b48ab538-b9fa-44e9-938f-b2837146160c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48ab538-b9fa-44e9-938f-b2837146160c', 'volume_size': 1} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:24 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 1073741824" returned: 0 in 0.700s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:24 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 Sep 25 17:24:24 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Flow 'volume_create_manager' (9bf0e236-931a-4587-b74b-cfcc796da180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c752a05-b934-4691-8057-5e29422c6697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c752a05-b934-4691-8057-5e29422c6697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-350572627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04128622-3a88-4637-9114-ae8c4a154afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebee894bbb14a7f92d311690e7414d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:24Z,use_quota=True,user_id='991dac067207413b9fba167691386928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aae8b32-61f0-487d-9a41-f36ea84a6c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aae8b32-61f0-487d-9a41-f36ea84a6c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02199e7a-7d5d-417f-8f20-9b47ea8936cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02199e7a-7d5d-417f-8f20-9b47ea8936cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04128622-3a88-4637-9114-ae8c4a154afe', 'volume_name': 'volume-04128622-3a88-4637-9114-ae8c4a154afe', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e5a850-f34b-4b6d-bdab-d1b82766ea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e5a850-f34b-4b6d-bdab-d1b82766ea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0273fb27-2a26-4197-9e92-1a6d30557984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Volume 04128622-3a88-4637-9114-ae8c4a154afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04128622-3a88-4637-9114-ae8c4a154afe', 'volume_size': 1} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:24 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4" returned: 0 in 0.450s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.978s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529461456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c5cb6e-386a-40af-8739-0f04fa8fd84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:24Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Creating volume 02c5cb6e-386a-40af-8739-0f04fa8fd84c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:24 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:24 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c 1073741824 Sep 25 17:24:24 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (170c3979-31be-4327-a622-45d5033bd231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e607ea9-7817-4474-b7b3-e3109c5dbf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cad4bb-97d7-4cd3-8182-416696b3351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f052ac9d-da48-4ba6-98e9-bf2fe08c231e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e607ea9-7817-4474-b7b3-e3109c5dbf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663164636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd17fd3-50a6-4af1-9543-2c29208c080c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:25Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f00b99e-a39f-468a-9ef0-4d6265eb7592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f00b99e-a39f-468a-9ef0-4d6265eb7592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0de5ddd-06e2-4311-82d5-1680a22de2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0de5ddd-06e2-4311-82d5-1680a22de2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd17fd3-50a6-4af1-9543-2c29208c080c', 'volume_name': 'volume-bdd17fd3-50a6-4af1-9543-2c29208c080c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd6faf6-3dd3-45d5-a685-f368a6fbe86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd6faf6-3dd3-45d5-a685-f368a6fbe86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb8ec2b-daf6-4ed3-97ad-bef600454d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Volume bdd17fd3-50a6-4af1-9543-2c29208c080c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd17fd3-50a6-4af1-9543-2c29208c080c', 'volume_size': 1} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Volume volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 (54ba1b4e-8b8f-4a36-8b63-1f491337eca4): created successfully Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f052ac9d-da48-4ba6-98e9-bf2fe08c231e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (e617dd2c-0591-4e85-80d2-69bad1f056ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-5405cd4b-f726-434a-a965-2225f4baa696 tempest-CreateVolumesFromImageTest-366217663 None] Created volume successfully. Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (820e5f18-f7b7-4d6d-8a27-65a32ae37fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b81bc0-2ba2-4962-9ff6-275ec1110e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b81bc0-2ba2-4962-9ff6-275ec1110e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639586656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7571a0d5-bdba-4112-b3ed-a8864059aa3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:25Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777f2222-4769-4116-b86b-30ab3214377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777f2222-4769-4116-b86b-30ab3214377c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f66232-e948-4a4d-8242-efeff68eea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f66232-e948-4a4d-8242-efeff68eea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7571a0d5-bdba-4112-b3ed-a8864059aa3e', 'volume_name': 'volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61435fb3-5af1-4c52-8d54-9509c5d4e0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61435fb3-5af1-4c52-8d54-9509c5d4e0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24903c5-59f4-4f2e-a02b-b329cfe8aef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Volume 7571a0d5-bdba-4112-b3ed-a8864059aa3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e', 'volume_size': 1} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:25 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c 1073741824" returned: 0 in 0.682s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:25 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c Sep 25 17:24:25 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (36205133-4de2-48c2-89e7-484a502fce17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3805a835-484e-4189-bcf4-13b13d1b22c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3805a835-484e-4189-bcf4-13b13d1b22c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1456016178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:26Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788ef73f-6584-4b5d-b18b-b9f529c47f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788ef73f-6584-4b5d-b18b-b9f529c47f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e8b7e6-9040-4c0a-afd2-a0bd7f088d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e8b7e6-9040-4c0a-afd2-a0bd7f088d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4', 'volume_name': 'volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d340c9-c1ef-4245-b951-edfb2da4db81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d340c9-c1ef-4245-b951-edfb2da4db81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83f99df-1355-489b-b121-72e27439ac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Volume 3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4', 'volume_size': 1} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c" returned: 0 in 0.430s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.742s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209950071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48ab538-b9fa-44e9-938f-b2837146160c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:24Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Creating volume b48ab538-b9fa-44e9-938f-b2837146160c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:26 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f0c7d0-0ca5-4923-a9b8-1e8ac85efbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd64c39-eef9-4002-a0d6-080264cdc90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c 1073741824 Sep 25 17:24:26 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:26 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c (02c5cb6e-386a-40af-8739-0f04fa8fd84c): created successfully Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd64c39-eef9-4002-a0d6-080264cdc90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (8cf1e07c-200d-4787-bc54-162c3ecde6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:26 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-95f0e16d-b10a-4edd-af0d-6d0f7e4137f8 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created volume successfully. Sep 25 17:24:26 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c 1073741824" returned: 0 in 0.544s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:26 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c Sep 25 17:24:26 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:26 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.320s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-350572627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04128622-3a88-4637-9114-ae8c4a154afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebee894bbb14a7f92d311690e7414d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:24Z,use_quota=True,user_id='991dac067207413b9fba167691386928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Creating volume 04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:26 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fae59b0-89c7-400b-99bf-1514565c75b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48ab538-b9fa-44e9-938f-b2837146160c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:26 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d989214c-4655-4c2c-a465-7ce5d88d11c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:26 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe 1073741824 Sep 25 17:24:27 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:27 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Volume volume-b48ab538-b9fa-44e9-938f-b2837146160c (b48ab538-b9fa-44e9-938f-b2837146160c): created successfully Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d989214c-4655-4c2c-a465-7ce5d88d11c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (51d4ff87-48c6-4ef3-a402-9aee8925807a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-36925f78-fd24-4ab0-9037-b99d50e8a2db tempest-CreateVolumesFromImageTest-366217663 None] Created volume successfully. Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:27 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe 1073741824" returned: 0 in 0.600s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:27 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe Sep 25 17:24:27 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:27 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.793s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-663164636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd17fd3-50a6-4af1-9543-2c29208c080c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:25Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Creating volume bdd17fd3-50a6-4af1-9543-2c29208c080c {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:27 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0273fb27-2a26-4197-9e92-1a6d30557984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04128622-3a88-4637-9114-ae8c4a154afe', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:27 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c 1073741824 Sep 25 17:24:27 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b6b6db-0af5-4dfe-ae76-067060153659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:27 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Volume volume-04128622-3a88-4637-9114-ae8c4a154afe (04128622-3a88-4637-9114-ae8c4a154afe): created successfully Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b6b6db-0af5-4dfe-ae76-067060153659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:27 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Flow 'volume_create_manager' (9bf0e236-931a-4587-b74b-cfcc796da180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:27 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d352d74d-fbde-49e5-b981-82bc21a5eb44 tempest-VolumeDependencyTests-1867087700 None] Created volume successfully. Sep 25 17:24:28 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c 1073741824" returned: 0 in 0.466s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:28 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c Sep 25 17:24:28 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Flow 'volume_create_manager' (5dc89c21-1813-495b-9216-90e923847b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42dc9c4a-ecaa-4231-b079-75db8e17ca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42dc9c4a-ecaa-4231-b079-75db8e17ca11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5283caa-ef8e-4fea-8ff6-39fe9941f3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8571f3ead6486184bb32aa6a669475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:29Z,use_quota=True,user_id='3309d680187d429aaa4f0e47175f287a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54dba636-9508-4f95-a73d-9c8724f3b182),volume_type_id=54dba636-9508-4f95-a73d-9c8724f3b182)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ba4277-5608-4868-8b0d-7ce2242e9b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:28 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ba4277-5608-4868-8b0d-7ce2242e9b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b953b7-24bd-4566-97cf-1af2c16cbe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.291s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639586656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7571a0d5-bdba-4112-b3ed-a8864059aa3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:25Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Creating volume 7571a0d5-bdba-4112-b3ed-a8864059aa3e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:28 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb8ec2b-daf6-4ed3-97ad-bef600454d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd17fd3-50a6-4af1-9543-2c29208c080c', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42521865-3686-4454-866c-82dd2e005ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:28 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e 1073741824 Sep 25 17:24:28 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:28 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Volume volume-bdd17fd3-50a6-4af1-9543-2c29208c080c (bdd17fd3-50a6-4af1-9543-2c29208c080c): created successfully Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42521865-3686-4454-866c-82dd2e005ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (170c3979-31be-4327-a622-45d5033bd231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:28 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bac32927-28e7-4bfe-84fd-1383a5b69084 tempest-CreateVolumesFromImageTest-366217663 None] Created volume successfully. Sep 25 17:24:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b953b7-24bd-4566-97cf-1af2c16cbe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5283caa-ef8e-4fea-8ff6-39fe9941f3dc', 'volume_name': 'volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc', 'volume_size': 1, 'image_id': 'e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5254d5aa720e1d8b23e9f9131fbaa2c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad8571f3ead6486184bb32aa6a669475', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e1c9d5234029fcdfef04085a5fb05bd2c9f39033d5dcb0087f00eed69e002e33e82c1ca4603750bfa5da99f812d79cd656301dd02941e10887ff8db0e9995840', 'id': 'e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'created_at': datetime.datetime(2026, 9, 25, 15, 24, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 24, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4c91dff-5116-4435-9f77-bfc1bc715bcf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6716348c-913b-4ccc-b990-a66d9041fc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6716348c-913b-4ccc-b990-a66d9041fc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01314ed5-bc9d-4153-a479-f86996108c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Volume f5283caa-ef8e-4fea-8ff6-39fe9941f3dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc', 'volume_size': 1, 'image_id': 'e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5254d5aa720e1d8b23e9f9131fbaa2c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad8571f3ead6486184bb32aa6a669475', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e1c9d5234029fcdfef04085a5fb05bd2c9f39033d5dcb0087f00eed69e002e33e82c1ca4603750bfa5da99f812d79cd656301dd02941e10887ff8db0e9995840', 'id': 'e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'created_at': datetime.datetime(2026, 9, 25, 15, 24, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 24, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4c91dff-5116-4435-9f77-bfc1bc715bcf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Trying to clone f5283caa-ef8e-4fea-8ff6-39fe9941f3dc from image e4c91dff-5116-4435-9f77-bfc1bc715bcf at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:24:29 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Image download 0.00 MB at 0.00 MB/s Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad02860-718d-42fe-ba7c-1f8623c35561]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:29 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e 1073741824" returned: 0 in 0.606s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:29 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD Sep 25 17:24:29 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:29 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e Sep 25 17:24:29 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:29 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:29 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.702s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1456016178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377834342b07412a8a84ed9037811425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:26Z,use_quota=True,user_id='25d8e1a1132f432793c3f09653f558cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Creating volume 3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:29 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24903c5-59f4-4f2e-a02b-b329cfe8aef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:29 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 1073741824 Sep 25 17:24:29 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27d3948-502e-4b8b-84a2-0b96663ed1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:29 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Volume volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e (7571a0d5-bdba-4112-b3ed-a8864059aa3e): created successfully Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27d3948-502e-4b8b-84a2-0b96663ed1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:29 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (820e5f18-f7b7-4d6d-8a27-65a32ae37fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:29 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD Sep 25 17:24:29 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1a9be25a-7883-43d6-9be3-f19ba1d906d6 tempest-CreateVolumesFromImageTest-366217663 None] Created volume successfully. Sep 25 17:24:30 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD" returned: 1 in 0.382s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Temporary image e4c91dff-5116-4435-9f77-bfc1bc715bcf is fetched for user 3309d680187d429aaa4f0e47175f287a. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e57294-e70f-40ce-9e29-beaf1e1e42b4]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:30 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD Sep 25 17:24:30 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:30 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 1073741824" returned: 0 in 0.531s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:30 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 Sep 25 17:24:30 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:30 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:30 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.175s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Creating offline snapshot 20bf0934-0619-4a43-b70f-30f0971d7d64 of volume 02c5cb6e-386a-40af-8739-0f04fa8fd84c {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83f99df-1355-489b-b121-72e27439ac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:30 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD Sep 25 17:24:30 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b774cc5a-f4fe-404a-a6c2-c677f0e96bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d7e621-6106-4ae8-b39c-78c69eab4d8e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:30 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Volume volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 (3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4): created successfully Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b774cc5a-f4fe-404a-a6c2-c677f0e96bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Flow 'volume_create_manager' (36205133-4de2-48c2-89e7-484a502fce17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:30 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1e119323-382f-4699-9b80-94ce84c090a3 tempest-CreateVolumesFromImageTest-366217663 None] Created volume successfully. Sep 25 17:24:30 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c Sep 25 17:24:30 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:30 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:24:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:31 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c" returned: 0 in 0.413s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:31 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 1G Sep 25 17:24:31 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:31 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 1G" returned: 0 in 0.463s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:31 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 Sep 25 17:24:31 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-quobyte-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4" acquired by "delete_volume" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8519f7-9681-49f1-882e-0dc01ba61c0a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:31 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 Sep 25 17:24:31 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:31 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:31 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 is being set with open permissions: ugo+rw Sep 25 17:24:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:31 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 Sep 25 17:24:31 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:32 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:32 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4 Sep 25 17:24:32 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:32 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64" returned: 0 in 0.289s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:32 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.info Sep 25 17:24:32 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:32 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4" returned: 0 in 0.297s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4" released by "delete_volume" :: held 0.767s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Created reservations ['99c8ddd0-cff3-44c2-8e2c-b01f8897d829', 'c54d261f-6639-4c98-bd32-b4dedaef21cb', '600f0ecb-277e-4336-8fcc-c1b355212916', 'd5735dac-868a-4354-bbdd-1789989f8bc0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:32 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.info" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.info is being set with open permissions: ugo+rw Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:32 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:32 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:32 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.info Sep 25 17:24:32 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-7571a0d5-bdba-4112-b3ed-a8864059aa3e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-7571a0d5-bdba-4112-b3ed-a8864059aa3e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-quobyte-7571a0d5-bdba-4112-b3ed-a8864059aa3e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:32 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.info" returned: 0 in 0.318s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.953s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:32 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-7571a0d5-bdba-4112-b3ed-a8864059aa3e" acquired by "delete_volume" :: waited 0.062s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Creating offline snapshot ecbc6a96-1951-4d70-ba58-1ad710efc891 of volume 04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:24:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Deleted volume successfully. Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7435931a-936d-4075-b6be-0adbcdd06804]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dc70be-b03a-4cf5-b68f-de7a5ddbdc17]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0e84ab82-1ce0-4837-843d-8b4df87bb859 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Create snapshot completed successfully Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0ca9eb63-0ace-4694-9084-5d15660a3b10 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-3d5f478a-cd68-46d7-a2ab-5fd9cb689dd4-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:33 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e Sep 25 17:24:33 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe Sep 25 17:24:33 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe" returned: 0 in 0.424s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 1G Sep 25 17:24:33 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e" returned: 0 in 0.476s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:33 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e Sep 25 17:24:33 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:33 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7571a0d5-bdba-4112-b3ed-a8864059aa3e" returned: 0 in 0.308s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-7571a0d5-bdba-4112-b3ed-a8864059aa3e" released by "delete_volume" :: held 0.856s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:33 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Created reservations ['2a51e72c-4db9-489d-8fd0-30e830e41854', 'ad9de87d-7879-4161-910b-c8573dd87cea', '723d031b-99f2-4387-beb8-e9a9a52e339f', '8d61bec6-87a1-4790-afb6-8f22b3a67b16'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:34 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 1G" returned: 0 in 0.581s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04128622-3a88-4637-9114-ae8c4a154afe -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:34 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:34 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-bdd17fd3-50a6-4af1-9543-2c29208c080c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:34 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04128622-3a88-4637-9114-ae8c4a154afe -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 Sep 25 17:24:34 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-bdd17fd3-50a6-4af1-9543-2c29208c080c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-quobyte-bdd17fd3-50a6-4af1-9543-2c29208c080c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-bdd17fd3-50a6-4af1-9543-2c29208c080c" acquired by "delete_volume" :: waited 0.044s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5042ed8b-7159-4fef-bfbb-3b75903d27c0]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:34 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c Sep 25 17:24:34 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:34 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.531s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Deleted volume successfully. Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:34 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (e9db86ac-12d9-44b4-a740-924aa3d89be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0f0657-a841-4168-962c-455493f20d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04128622-3a88-4637-9114-ae8c4a154afe -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891" returned: 0 in 0.595s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:34 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 is being set with open permissions: ugo+rw Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-81b64903-dacc-4227-92ce-bfdf1a463022 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-7571a0d5-bdba-4112-b3ed-a8864059aa3e-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0f0657-a841-4168-962c-455493f20d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1613141339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47a4424-a8b4-49ae-bbed-018f0d631ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:34Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63681f5-eedb-4190-96f4-072a2dddd2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:34 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 Sep 25 17:24:34 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63681f5-eedb-4190-96f4-072a2dddd2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ddde18-6973-40c8-a8af-9588c867cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ddde18-6973-40c8-a8af-9588c867cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47a4424-a8b4-49ae-bbed-018f0d631ba3', 'volume_name': 'volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5fcccf-844e-48bd-a026-a1d2307bf224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5fcccf-844e-48bd-a026-a1d2307bf224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3e234a-0486-474f-93df-9efbe269f21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume e47a4424-a8b4-49ae-bbed-018f0d631ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3', 'volume_size': 1} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:34 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c" returned: 0 in 0.488s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:34 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c Sep 25 17:24:34 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:34 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (68c4133f-ada1-46a8-84b7-a2f492022b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f069035-9e20-4dd4-8a14-ec1d79aa15f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f069035-9e20-4dd4-8a14-ec1d79aa15f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753116583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f014c6-692b-47e5-8fcf-bed81abca354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:35Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162623e8-86aa-46bd-bdd5-fa681ae335c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162623e8-86aa-46bd-bdd5-fa681ae335c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9107757-025a-4219-8da0-b60949e76e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9107757-025a-4219-8da0-b60949e76e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f014c6-692b-47e5-8fcf-bed81abca354', 'volume_name': 'volume-56f014c6-692b-47e5-8fcf-bed81abca354', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:35 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e50c7a-2f5d-478e-80f6-77544790b5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e50c7a-2f5d-478e-80f6-77544790b5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a631acbf-7985-4cfa-b842-715969f349a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume 56f014c6-692b-47e5-8fcf-bed81abca354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f014c6-692b-47e5-8fcf-bed81abca354', 'volume_size': 1} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-bdd17fd3-50a6-4af1-9543-2c29208c080c" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-bdd17fd3-50a6-4af1-9543-2c29208c080c" released by "delete_volume" :: held 0.984s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:35 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.info Sep 25 17:24:35 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Created reservations ['d1eebfc0-41d4-4dfb-980b-0f777e7e0407', '660406eb-759e-4b7a-89e6-07b67493fcb3', '80a6ce5c-cb8c-478f-91af-96996b283095', 'c4d67036-b64b-4e42-967c-c4b3cd51a992'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:35 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:35 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (fe1a5ace-01b3-490b-b9fc-224bf80b98bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a106ae05-e1df-4abc-a56a-dc26b4827102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a106ae05-e1df-4abc-a56a-dc26b4827102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664263307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff615b0-ea2b-4d74-b07f-bab4c3312f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:35Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e02df13-972d-499a-8846-879966d2a25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e02df13-972d-499a-8846-879966d2a25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3292d345-23e6-48ba-a8e7-afe554872f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3292d345-23e6-48ba-a8e7-afe554872f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff615b0-ea2b-4d74-b07f-bab4c3312f3e', 'volume_name': 'volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069b929-07ed-415b-917f-0342446d5175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069b929-07ed-415b-917f-0342446d5175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c164ca-a881-4d2f-86a6-cae643b1525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume 1ff615b0-ea2b-4d74-b07f-bab4c3312f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e', 'volume_size': 1} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.info" returned: 0 in 0.436s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.info is being set with open permissions: ugo+rw Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:35 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.info Sep 25 17:24:35 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:35 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Deleted volume successfully. Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-92a500e0-a926-4acc-b602-88e13a541ce9 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-bdd17fd3-50a6-4af1-9543-2c29208c080c-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:35 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.info" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.079s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5283caa-ef8e-4fea-8ff6-39fe9941f3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8571f3ead6486184bb32aa6a669475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:29Z,use_quota=True,user_id='3309d680187d429aaa4f0e47175f287a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54dba636-9508-4f95-a73d-9c8724f3b182),volume_type_id=54dba636-9508-4f95-a73d-9c8724f3b182)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Creating volume f5283caa-ef8e-4fea-8ff6-39fe9941f3dc {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:36 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:36 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc 1073741824 Sep 25 17:24:36 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (e2a799a6-b8d8-4329-a980-08a8737ce9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620160c6-ee25-472a-93b6-31987f95765f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620160c6-ee25-472a-93b6-31987f95765f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061534654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911e81f7-be9f-40d1-aa7b-7aa1220fe71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:36Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8f3beb-af80-4c0f-8393-1b30ff8f20dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8f3beb-af80-4c0f-8393-1b30ff8f20dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4b1742-2537-4e10-b385-3dfc3701c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4b1742-2537-4e10-b385-3dfc3701c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '911e81f7-be9f-40d1-aa7b-7aa1220fe71e', 'volume_name': 'volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7569bb16-e30e-4679-836c-2a00b7852adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7569bb16-e30e-4679-836c-2a00b7852adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8411ad50-0e96-4eeb-9968-12adf0fba0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume 911e81f7-be9f-40d1-aa7b-7aa1220fe71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e', 'volume_size': 1} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6a0bba0d-80ca-4074-a81d-1c601c1b7293 tempest-VolumeDependencyTests-1867087700 None] Create snapshot completed successfully Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-b48ab538-b9fa-44e9-938f-b2837146160c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (cf60e909-be95-4f62-8dfc-d53d7222a68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e4a507-873d-4695-960b-cd0bb39cec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-b48ab538-b9fa-44e9-938f-b2837146160c-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e4a507-873d-4695-960b-cd0bb39cec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333630623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5f98ce-1c84-409c-9af3-5176c37eb354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:36Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d422c22-f351-4bf7-a35d-eb8a1eb1c4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d422c22-f351-4bf7-a35d-eb8a1eb1c4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b28e410-a0c8-445b-a1ac-bbcea7d139cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b28e410-a0c8-445b-a1ac-bbcea7d139cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d5f98ce-1c84-409c-9af3-5176c37eb354', 'volume_name': 'volume-6d5f98ce-1c84-409c-9af3-5176c37eb354', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:36 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351572dd-07c1-4185-9fad-0a1b16716903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351572dd-07c1-4185-9fad-0a1b16716903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fb83a6-45d3-4412-b1ca-5d826ecedd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume 6d5f98ce-1c84-409c-9af3-5176c37eb354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d5f98ce-1c84-409c-9af3-5176c37eb354', 'volume_size': 1} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc 1073741824" returned: 0 in 0.609s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-quobyte-b48ab538-b9fa-44e9-938f-b2837146160c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-b48ab538-b9fa-44e9-938f-b2837146160c" acquired by "delete_volume" :: waited 0.040s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:36 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc Sep 25 17:24:36 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[14410ddb-2e20-4d90-bfaf-73d1c06d6fe7]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:36 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c Sep 25 17:24:36 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.311s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1613141339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47a4424-a8b4-49ae-bbed-018f0d631ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:34Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Creating volume e47a4424-a8b4-49ae-bbed-018f0d631ba3 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:37 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 1073741824 Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Attempting download of e4c91dff-5116-4435-9f77-bfc1bc715bcf ((None, [{'url': 'file:///opt/stack/data/glance/images/e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'metadata': {}}])) to volume f5283caa-ef8e-4fea-8ff6-39fe9941f3dc. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:24:37 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfff5966-03cd-4fc1-822b-c221a7219cff]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4c91dff-5116-4435-9f77-bfc1bc715bcf_amrp_s7r {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:37 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Flow 'volume_create_manager' (5da22c7c-4b23-42db-9006-352a198ef7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a3495f-cc3f-4f29-a4e5-7c2b489d1612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4c91dff-5116-4435-9f77-bfc1bc715bcf_amrp_s7r Sep 25 17:24:37 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c" returned: 0 in 0.667s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c Sep 25 17:24:37 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a3495f-cc3f-4f29-a4e5-7c2b489d1612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2138038879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0804f23b-b07b-4d7e-9d1a-0cbadd6eb800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebee894bbb14a7f92d311690e7414d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ecbc6a96-1951-4d70-ba58-1ad710efc891,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:37Z,use_quota=True,user_id='991dac067207413b9fba167691386928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804842ef-943f-4afa-85e5-854c35edaf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804842ef-943f-4afa-85e5-854c35edaf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518d4b93-d670-445e-a03e-4d27996a4061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518d4b93-d670-445e-a03e-4d27996a4061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0804f23b-b07b-4d7e-9d1a-0cbadd6eb800', 'volume_name': 'volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800', 'volume_size': 1, 'snapshot_id': 'ecbc6a96-1951-4d70-ba58-1ad710efc891'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1791602b-600a-4149-9b64-fcef32656201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1791602b-600a-4149-9b64-fcef32656201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c84d19-3d81-4b55-a34c-f4f8207238ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Volume 0804f23b-b07b-4d7e-9d1a-0cbadd6eb800: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800', 'volume_size': 1, 'snapshot_id': 'ecbc6a96-1951-4d70-ba58-1ad710efc891'} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:37 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b48ab538-b9fa-44e9-938f-b2837146160c" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:37 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4c91dff-5116-4435-9f77-bfc1bc715bcf_amrp_s7r" returned: 0 in 0.550s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4c91dff-5116-4435-9f77-bfc1bc715bcf_amrp_s7r {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-b48ab538-b9fa-44e9-938f-b2837146160c" released by "delete_volume" :: held 1.078s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 1073741824" returned: 0 in 0.739s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Created reservations ['37394f5c-7d2e-4d04-a5fb-addae1417af2', 'b5043355-2cfa-4c34-b38d-2cf9ad70acce', 'a149d1fe-92ba-41ba-9df0-0ee8c40e55bc', '008184dd-7f50-4560-a2fc-75558dffa9f1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:37 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 Sep 25 17:24:37 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4c91dff-5116-4435-9f77-bfc1bc715bcf_amrp_s7r Sep 25 17:24:37 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:37 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:37 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:38 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3" returned: 0 in 0.299s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.990s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753116583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f014c6-692b-47e5-8fcf-bed81abca354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:35Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Creating volume 56f014c6-692b-47e5-8fcf-bed81abca354 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:38 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:38 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4c91dff-5116-4435-9f77-bfc1bc715bcf_amrp_s7r" returned: 1 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4c91dff-5116-4435-9f77-bfc1bc715bcf_amrp_s7r' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:24:38 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354 1073741824 Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3e234a-0486-474f-93df-9efbe269f21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:38 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a540da99-9fd1-4f19-9b52-ff29f33ec8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ef1131-4471-43a9-b17b-2da32bd2b8cf]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:38 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.264s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 (e47a4424-a8b4-49ae-bbed-018f0d631ba3): created successfully Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a540da99-9fd1-4f19-9b52-ff29f33ec8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (e9db86ac-12d9-44b4-a740-924aa3d89be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Deleted volume successfully. Sep 25 17:24:38 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8d80ffe2-788b-4e2e-be5c-f4790c155720 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created volume successfully. Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4b1af6a0-de2b-479d-acf4-f3561db34071 tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-b48ab538-b9fa-44e9-938f-b2837146160c-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:38 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD Sep 25 17:24:38 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:38 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:38 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354 1073741824" returned: 0 in 0.477s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:38 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD Sep 25 17:24:38 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:38 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354 Sep 25 17:24:38 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-54ba1b4e-8b8f-4a36-8b63-1f491337eca4-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-54ba1b4e-8b8f-4a36-8b63-1f491337eca4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:38 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:24:38 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] e4c91dff-5116-4435-9f77-bfc1bc715bcf was raw, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:24:39 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354" returned: 0 in 0.349s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.427s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:39 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc Sep 25 17:24:39 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-664263307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff615b0-ea2b-4d74-b07f-bab4c3312f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:35Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Creating volume 1ff615b0-ea2b-4d74-b07f-bab4c3312f3e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:39 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "cinder-quobyte-54ba1b4e-8b8f-4a36-8b63-1f491337eca4" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:39 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e 1073741824 Sep 25 17:24:39 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a631acbf-7985-4cfa-b842-715969f349a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f014c6-692b-47e5-8fcf-bed81abca354', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8673a87-36eb-4254-8fb7-22850e1f7dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:39 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume volume-56f014c6-692b-47e5-8fcf-bed81abca354 (56f014c6-692b-47e5-8fcf-bed81abca354): created successfully Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8673a87-36eb-4254-8fb7-22850e1f7dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (68c4133f-ada1-46a8-84b7-a2f492022b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-54ba1b4e-8b8f-4a36-8b63-1f491337eca4" acquired by "delete_volume" :: waited 0.059s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4b03073d-1a0b-4f36-a4fb-55be9e94d108 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created volume successfully. Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[195b374d-38bc-400f-a863-08afa705c555]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:39 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 Sep 25 17:24:39 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:39 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc" returned: 0 in 0.653s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4c91dff-5116-4435-9f77-bfc1bc715bcf_kxio3iz8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:24:39 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:39 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e 1073741824" returned: 0 in 0.655s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:39 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc 1G Sep 25 17:24:39 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:39 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4" returned: 0 in 0.586s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:39 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e Sep 25 17:24:39 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:39 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4 Sep 25 17:24:39 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:40 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:40 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.920s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:40 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061534654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911e81f7-be9f-40d1-aa7b-7aa1220fe71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:36Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Creating volume 911e81f7-be9f-40d1-aa7b-7aa1220fe71e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:40 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc 1G" returned: 0 in 0.440s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Downloaded image e4c91dff-5116-4435-9f77-bfc1bc715bcf ((None, [{'url': 'file:///opt/stack/data/glance/images/e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'metadata': {}}])) to volume f5283caa-ef8e-4fea-8ff6-39fe9941f3dc successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Temporary image e4c91dff-5116-4435-9f77-bfc1bc715bcf for user 3309d680187d429aaa4f0e47175f287a is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Marking volume f5283caa-ef8e-4fea-8ff6-39fe9941f3dc as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-54ba1b4e-8b8f-4a36-8b63-1f491337eca4" returned: 0 in 0.336s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:40 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e 1073741824 Sep 25 17:24:40 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c164ca-a881-4d2f-86a6-cae643b1525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d566506-da79-49ab-bd77-8488bda50da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Copying metadata from image e4c91dff-5116-4435-9f77-bfc1bc715bcf to f5283caa-ef8e-4fea-8ff6-39fe9941f3dc. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Creating volume glance metadata for volume f5283caa-ef8e-4fea-8ff6-39fe9941f3dc backed by image e4c91dff-5116-4435-9f77-bfc1bc715bcf with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5254d5aa720e1d8b23e9f9131fbaa2c7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:24:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e (1ff615b0-ea2b-4d74-b07f-bab4c3312f3e): created successfully Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d566506-da79-49ab-bd77-8488bda50da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (fe1a5ace-01b3-490b-b9fc-224bf80b98bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-quobyte-54ba1b4e-8b8f-4a36-8b63-1f491337eca4" released by "delete_volume" :: held 1.040s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b408972c-2d2d-4149-ab14-00c9ae7fc344 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created volume successfully. Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Created reservations ['ac8c3774-4e83-4b96-a520-62f33e91b0a7', '451bd643-81da-493c-9882-3ddc972ae28e', 'a27da177-146f-46b5-85b4-0b6b2445da59', '65554410-484f-4186-8bec-935484d41897'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01314ed5-bc9d-4153-a479-f86996108c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc', 'volume_size': 1, 'image_id': 'e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5254d5aa720e1d8b23e9f9131fbaa2c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad8571f3ead6486184bb32aa6a669475', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e1c9d5234029fcdfef04085a5fb05bd2c9f39033d5dcb0087f00eed69e002e33e82c1ca4603750bfa5da99f812d79cd656301dd02941e10887ff8db0e9995840', 'id': 'e4c91dff-5116-4435-9f77-bfc1bc715bcf', 'created_at': datetime.datetime(2026, 9, 25, 15, 24, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 24, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4c91dff-5116-4435-9f77-bfc1bc715bcf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39b2f02-bffd-49f8-b4b7-8e842ec07246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Volume volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc (f5283caa-ef8e-4fea-8ff6-39fe9941f3dc): created successfully Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39b2f02-bffd-49f8-b4b7-8e842ec07246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Flow 'volume_create_manager' (5dc89c21-1813-495b-9216-90e923847b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-40d88e36-cbbd-486f-890f-b8100c4f0910 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Created volume successfully. Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:40 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:40 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:40 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e 1073741824" returned: 0 in 0.511s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Acquiring lock "cinder-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:40 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "cinder-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.321s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:40 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:40 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:40 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Deleted volume successfully. Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Acquiring lock "cinder-quobyte-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-646fbdc5-e3fc-4f90-b72e-6628c80e106b tempest-CreateVolumesFromImageTest-366217663 None] Lock "cinder-54ba1b4e-8b8f-4a36-8b63-1f491337eca4-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "cinder-quobyte-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea2564b-a157-410b-9b11-d2f563919138]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:40 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc Sep 25 17:24:40 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:40 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.340s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333630623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5f98ce-1c84-409c-9af3-5176c37eb354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e379367abd64c818335b7106fa24442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:36Z,use_quota=True,user_id='4df22ca201d844f3a31997889adf2636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Creating volume 6d5f98ce-1c84-409c-9af3-5176c37eb354 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:40 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8411ad50-0e96-4eeb-9968-12adf0fba0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512304ec-f6be-4084-b23d-b6ebab0da74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:41 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 1073741824 Sep 25 17:24:41 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e (911e81f7-be9f-40d1-aa7b-7aa1220fe71e): created successfully Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512304ec-f6be-4084-b23d-b6ebab0da74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (e2a799a6-b8d8-4329-a980-08a8737ce9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1a9cd8f2-b514-463f-ae7f-aab59960875c tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created volume successfully. Sep 25 17:24:41 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc" returned: 0 in 0.460s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:41 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc Sep 25 17:24:41 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:41 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 1073741824" returned: 0 in 0.598s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:41 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc" returned: 0 in 0.302s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "cinder-quobyte-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc" released by "delete_volume" :: held 0.837s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:41 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 Sep 25 17:24:41 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Created reservations ['ef070917-ea6c-411c-9552-8630b8f697ae', 'f858da8e-deec-4a08-bb8f-66475f8b3286', '608e06f3-2fab-4037-9cac-8beae71bd24f', '70a2f7ab-8945-4cf7-a7b4-b37b1fb1becf'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:41 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:41 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:42 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.475s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "cinder-quobyte-ecbc6a96-1951-4d70-ba58-1ad710efc891-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fb83a6-45d3-4412-b1ca-5d826ecedd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5f98ce-1c84-409c-9af3-5176c37eb354', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307daf27-5f8d-4889-8ea1-55cbe39d70a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-ecbc6a96-1951-4d70-ba58-1ad710efc891-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Creating volume 0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 from snapshot ecbc6a96-1951-4d70-ba58-1ad710efc891 {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "cinder-quobyte-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:42 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Volume volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 (6d5f98ce-1c84-409c-9af3-5176c37eb354): created successfully Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307daf27-5f8d-4889-8ea1-55cbe39d70a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Flow 'volume_create_manager' (cf60e909-be95-4f62-8dfc-d53d7222a68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] snapshot: ecbc6a96-1951-4d70-ba58-1ad710efc891, volume: 0804f23b-b07b-4d7e-9d1a-0cbadd6eb800, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:24:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2b7baf85-4e74-47a2-a950-c359891afd10 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created volume successfully. Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e5e5f7-9d9a-4dc2-bf3a-6df9773bfa0c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:42 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Deleted volume successfully. Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-05f58702-2e13-4385-ba61-8b68d7452b45 tempest-VolumeAndVolumeTypeFromImageTest-948053918 None] Lock "cinder-f5283caa-ef8e-4fea-8ff6-39fe9941f3dc-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:42 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 Sep 25 17:24:42 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:42 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891" returned: 0 in 0.423s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04128622-3a88-4637-9114-ae8c4a154afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b820ec07-de10-48d0-aa16-ad7b16dcd7ef]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:42 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe Sep 25 17:24:42 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:43 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe" returned: 0 in 0.500s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-6d5f98ce-1c84-409c-9af3-5176c37eb354-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:43 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 Sep 25 17:24:43 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-6d5f98ce-1c84-409c-9af3-5176c37eb354-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-quobyte-6d5f98ce-1c84-409c-9af3-5176c37eb354" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-6d5f98ce-1c84-409c-9af3-5176c37eb354" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[36591478-333d-47fd-ac83-b4699dc4f3b3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:43 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 Sep 25 17:24:43 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:43 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354" returned: 0 in 0.611s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:44 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354 Sep 25 17:24:44 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:44 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-6d5f98ce-1c84-409c-9af3-5176c37eb354" returned: 0 in 0.419s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-6d5f98ce-1c84-409c-9af3-5176c37eb354" released by "delete_volume" :: held 1.134s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created reservations ['3c319282-e6d8-4155-80d0-d87041527d11', '7d2549c2-a4e6-460e-b541-2afa050030fc', '1716e1b6-d3cb-4252-acd8-7ca507684a47', '91f32ca8-9f63-4ff4-bdfa-97f5378ed06d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:44 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:44 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:45 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.611s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:45 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Deleted volume successfully. Sep 25 17:24:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b4cab6b8-6942-4965-8312-319c96b802a5 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-6d5f98ce-1c84-409c-9af3-5176c37eb354-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-911e81f7-be9f-40d1-aa7b-7aa1220fe71e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-911e81f7-be9f-40d1-aa7b-7aa1220fe71e-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-quobyte-911e81f7-be9f-40d1-aa7b-7aa1220fe71e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-911e81f7-be9f-40d1-aa7b-7aa1220fe71e" acquired by "delete_volume" :: waited 0.070s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee059e-cc2d-4c63-817f-b485ae341f3f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:46 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e Sep 25 17:24:46 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (4c5d998b-02fc-4b5d-9e96-f61965dbfd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43aebffa-d424-454b-9a3a-0c083d3da825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43aebffa-d424-454b-9a3a-0c083d3da825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-187964949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f731d7-138a-44c8-a597-d32fbfecc328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:46Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc458d02-861e-4afd-b08f-49ff6f649265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc458d02-861e-4afd-b08f-49ff6f649265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99bf02f-b730-4bd8-8ee3-faf44380f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99bf02f-b730-4bd8-8ee3-faf44380f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f731d7-138a-44c8-a597-d32fbfecc328', 'volume_name': 'volume-d6f731d7-138a-44c8-a597-d32fbfecc328', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458eb205-8ac2-48c5-a6f4-552a6efc84c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458eb205-8ac2-48c5-a6f4-552a6efc84c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9ffcc6-9a77-4aa3-8d5e-a5e70921d55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume d6f731d7-138a-44c8-a597-d32fbfecc328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f731d7-138a-44c8-a597-d32fbfecc328', 'volume_size': 1} Sep 25 17:24:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:47 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e" returned: 0 in 1.221s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:47 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e Sep 25 17:24:47 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:47 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-911e81f7-be9f-40d1-aa7b-7aa1220fe71e" returned: 0 in 0.578s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-911e81f7-be9f-40d1-aa7b-7aa1220fe71e" released by "delete_volume" :: held 1.935s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:48 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created reservations ['5326fe4e-a59d-453a-a19b-3b66ee380836', '55f204a4-f9f1-4219-8ca7-1297483a08f9', 'e638a3dc-cfa1-447f-81f2-0691ac47f5a7', 'b923d488-264c-4c31-b26e-aced647ef399'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:48 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:48 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:48 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.668s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:48 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:48 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Deleted volume successfully. Sep 25 17:24:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c2779da3-c15a-47bd-a892-1705ab7e5ee4 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-911e81f7-be9f-40d1-aa7b-7aa1220fe71e-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-quobyte-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e" acquired by "delete_volume" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b440d4-d6fa-4b96-897c-aca32985e199]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:50 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e Sep 25 17:24:50 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:50 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e" returned: 0 in 0.935s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:50 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e Sep 25 17:24:50 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:51 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e" returned: 0 in 0.549s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e" released by "delete_volume" :: held 1.591s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:51 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created reservations ['544e3e7e-91fd-4545-bc7b-abd63c4f9ab9', 'effa715c-5a0b-41d6-9a30-461bea387263', '6d285f62-861d-4a12-8af6-a44f482f959b', '52e30e07-226d-4dd4-b8b4-a9d7126bf5d4'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:51 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:51 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-56f014c6-692b-47e5-8fcf-bed81abca354-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-56f014c6-692b-47e5-8fcf-bed81abca354-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-quobyte-56f014c6-692b-47e5-8fcf-bed81abca354" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-56f014c6-692b-47e5-8fcf-bed81abca354" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:52 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" returned: 0 in 9.168s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe, size 1024.00 MB, duration 9.17 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:24:52 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Converted 1024.00 MB image at 111.68 MB/s Sep 25 17:24:52 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 is being set with open permissions: ugo+rw Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a8a465-eee8-4fac-bee3-075e688b2159]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:52 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 Sep 25 17:24:52 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:52 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.574s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Deleted volume successfully. Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-02c31207-efa0-4c32-b841-a634dec805a7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-1ff615b0-ea2b-4d74-b07f-bab4c3312f3e-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:52 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354 Sep 25 17:24:52 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:52 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" released by "_copy_volume_from_snapshot" :: held 10.553s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-ecbc6a96-1951-4d70-ba58-1ad710efc891-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" released by "_create_volume_from_snapshot" :: held 10.669s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.712s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.939s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-187964949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f731d7-138a-44c8-a597-d32fbfecc328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:46Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Creating volume d6f731d7-138a-44c8-a597-d32fbfecc328 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:52 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:52 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328 1073741824 Sep 25 17:24:52 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c84d19-3d81-4b55-a34c-f4f8207238ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800', 'volume_size': 1, 'snapshot_id': 'ecbc6a96-1951-4d70-ba58-1ad710efc891'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:52 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6b5e05-16c9-449b-9d8c-b6950bf65c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354" returned: 0 in 0.464s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:52 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Volume volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 (0804f23b-b07b-4d7e-9d1a-0cbadd6eb800): created successfully Sep 25 17:24:52 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354 Sep 25 17:24:52 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6b5e05-16c9-449b-9d8c-b6950bf65c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:52 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Flow 'volume_create_manager' (5da22c7c-4b23-42db-9006-352a198ef7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:52 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b91cae3d-54be-4206-8b34-8275695a845d tempest-VolumeDependencyTests-1867087700 None] Created volume successfully. Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "cinder-ecbc6a96-1951-4d70-ba58-1ad710efc891-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-ecbc6a96-1951-4d70-ba58-1ad710efc891-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "cinder-quobyte-04128622-3a88-4637-9114-ae8c4a154afe" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-04128622-3a88-4637-9114-ae8c4a154afe" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "cinder-quobyte-ecbc6a96-1951-4d70-ba58-1ad710efc891" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-ecbc6a96-1951-4d70-ba58-1ad710efc891" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Deleting offline snapshot ecbc6a96-1951-4d70-ba58-1ad710efc891 of volume 04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] snapshot_file for this snap is: volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f617174-7e8c-4d69-990a-873ae09ff939]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:53 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-56f014c6-692b-47e5-8fcf-bed81abca354" returned: 0 in 0.497s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-56f014c6-692b-47e5-8fcf-bed81abca354" released by "delete_volume" :: held 1.040s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:53 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 Sep 25 17:24:53 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created reservations ['ee7f99e5-07b1-4b94-877a-e8de9c850721', 'f092ef9b-459f-4c00-a748-8f0703cba58a', '457d84bb-565d-44dc-8891-8b43a311b05a', '2f795ea4-17e8-4d4a-899c-490e2d91cf4d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:53 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328 1073741824" returned: 0 in 0.702s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:53 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328 Sep 25 17:24:53 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:53 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:53 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:53 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891" returned: 0 in 0.468s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04128622-3a88-4637-9114-ae8c4a154afe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a54f3f-5ac1-4492-9331-4df159a5334c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:53 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328" returned: 0 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:53 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.337s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:53 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe Sep 25 17:24:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Deleted volume successfully. Sep 25 17:24:53 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9ffcc6-9a77-4aa3-8d5e-a5e70921d55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f731d7-138a-44c8-a597-d32fbfecc328', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db685aa-63b9-4fbe-abfd-c1b2d6c6733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:53 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume volume-d6f731d7-138a-44c8-a597-d32fbfecc328 (d6f731d7-138a-44c8-a597-d32fbfecc328): created successfully Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db685aa-63b9-4fbe-abfd-c1b2d6c6733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (4c5d998b-02fc-4b5d-9e96-f61965dbfd4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d84dbb3e-317a-40e0-bdf8-be0204184123 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-56f014c6-692b-47e5-8fcf-bed81abca354-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bca62c36-87d4-498d-84dd-d1cef0d04e51 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created volume successfully. Sep 25 17:24:54 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe" returned: 0 in 0.606s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:54 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 Sep 25 17:24:54 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-e47a4424-a8b4-49ae-bbed-018f0d631ba3-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-e47a4424-a8b4-49ae-bbed-018f0d631ba3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-quobyte-e47a4424-a8b4-49ae-bbed-018f0d631ba3" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-e47a4424-a8b4-49ae-bbed-018f0d631ba3" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[2042c8fc-7f43-467e-b00f-d995c7a930bb]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:54 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891" returned: 0 in 0.614s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:55 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891 Sep 25 17:24:55 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:55 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 Sep 25 17:24:55 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (b9e7f847-4ec2-4b3a-bec2-c91dd51fc06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217ea9e0-427f-4b7c-a67d-e2cdcba42fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217ea9e0-427f-4b7c-a67d-e2cdcba42fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429592674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73f816f-65e7-4714-b94e-bf55ff46c7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:55Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfa1282-017f-43a4-aac5-fcb2ed3f6dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfa1282-017f-43a4-aac5-fcb2ed3f6dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5514f2c3-fe38-4569-b17b-348fa3655267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5514f2c3-fe38-4569-b17b-348fa3655267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73f816f-65e7-4714-b94e-bf55ff46c7d0', 'volume_name': 'volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecec7e2b-7d14-4071-a9f7-e7cc6760c94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecec7e2b-7d14-4071-a9f7-e7cc6760c94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8685b004-933e-4f87-8075-68ffbddf8184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Volume d73f816f-65e7-4714-b94e-bf55ff46c7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0', 'volume_size': 1} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429592674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73f816f-65e7-4714-b94e-bf55ff46c7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:55Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Creating volume d73f816f-65e7-4714-b94e-bf55ff46c7d0 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:55 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:55 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 1073741824 Sep 25 17:24:55 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (1e04ab82-62ea-4c87-802c-f5dfe7753097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac70b2e-467b-4a94-9d93-5ddf1e4c8eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac70b2e-467b-4a94-9d93-5ddf1e4c8eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570096366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7490241e-63c0-4a6c-afd1-a234dfedb58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:55Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f46789-aa9c-430a-a69d-e9b0749fce33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f46789-aa9c-430a-a69d-e9b0749fce33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef7233b-9c77-4cb1-980b-682811818889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef7233b-9c77-4cb1-980b-682811818889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7490241e-63c0-4a6c-afd1-a234dfedb58d', 'volume_name': 'volume-7490241e-63c0-4a6c-afd1-a234dfedb58d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9481f678-95bc-4ecd-9955-e143e2fe10eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9481f678-95bc-4ecd-9955-e143e2fe10eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d557564-b1a9-4276-8d11-bb2670d28ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume 7490241e-63c0-4a6c-afd1-a234dfedb58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7490241e-63c0-4a6c-afd1-a234dfedb58d', 'volume_size': 1} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:55 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe.ecbc6a96-1951-4d70-ba58-1ad710efc891" returned: 0 in 0.442s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-ecbc6a96-1951-4d70-ba58-1ad710efc891" released by "_delete_snapshot" :: held 2.331s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-04128622-3a88-4637-9114-ae8c4a154afe" released by "delete_snapshot" :: held 2.375s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:55 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3" returned: 0 in 0.656s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:55 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3 Sep 25 17:24:55 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Created reservations ['ae639328-2e51-4869-8cf5-08d92de0f417', '0242377e-0c3a-4908-b4b2-f9443539bbbb', '7c057690-96f5-4bd1-a02e-cf1940cd7a55', '2238acb9-f714-4735-8a03-59dba3f07f0b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Delete snapshot completed successfully. Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-049de5af-1ff8-405f-b4d6-d8826e115de2 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-ecbc6a96-1951-4d70-ba58-1ad710efc891-delete_snapshot" released by "delete_snapshot" :: held 2.642s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (420b5660-5bd8-48ef-bb8b-186ebb96cd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d0f749-3647-4d56-9e9a-007016b0c2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d0f749-3647-4d56-9e9a-007016b0c2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031455775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7a20da-369f-4064-9ee4-170063a0b6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:56Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f12cf93-0e9f-466e-a4ab-252dfd645966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f12cf93-0e9f-466e-a4ab-252dfd645966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4519e404-f1ec-4341-ae59-4f75007df05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4519e404-f1ec-4341-ae59-4f75007df05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d7a20da-369f-4064-9ee4-170063a0b6b1', 'volume_name': 'volume-1d7a20da-369f-4064-9ee4-170063a0b6b1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c0a1e9-c319-4127-94da-32ce8302b789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c0a1e9-c319-4127-94da-32ce8302b789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f13520-e013-41b3-b43b-d8ec49e474a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume 1d7a20da-369f-4064-9ee4-170063a0b6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d7a20da-369f-4064-9ee4-170063a0b6b1', 'volume_size': 1} Sep 25 17:24:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:56 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 1073741824" returned: 0 in 0.822s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:56 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-e47a4424-a8b4-49ae-bbed-018f0d631ba3" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-e47a4424-a8b4-49ae-bbed-018f0d631ba3" released by "delete_volume" :: held 1.225s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:56 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 Sep 25 17:24:56 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created reservations ['1f6cf5d9-96f0-4366-b908-a7f2ea4b1681', '7f9d6281-88b3-46ec-b032-c12e6e635d47', '53bb1746-3efd-4708-bfbc-3a34114ae2a9', '5e008246-2008-4f2e-aeb5-5f4a2073e8ce'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:56 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:56 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (5fad3193-b54a-4b02-a827-9decc814d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999f71ce-75b8-4287-9e0a-a5ffc7792b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "cinder-04128622-3a88-4637-9114-ae8c4a154afe-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999f71ce-75b8-4287-9e0a-a5ffc7792b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620984116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcc2fe5-0db9-417c-8bf6-c88f41b2756e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:56Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec63ce9a-a70e-4ca1-b8c6-02949d184624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec63ce9a-a70e-4ca1-b8c6-02949d184624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a91ed05-6d18-4177-9d52-b2db33cb2282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a91ed05-6d18-4177-9d52-b2db33cb2282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dcc2fe5-0db9-417c-8bf6-c88f41b2756e', 'volume_name': 'volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d68bb5-d0c9-4156-bca4-491fc5de4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d68bb5-d0c9-4156-bca4-491fc5de4e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abec1a1e-3a87-49fc-ab16-88ecde478fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume 7dcc2fe5-0db9-417c-8bf6-c88f41b2756e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e', 'volume_size': 1} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-04128622-3a88-4637-9114-ae8c4a154afe-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:56 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:56 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:56 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0" returned: 0 in 0.477s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.153s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-570096366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7490241e-63c0-4a6c-afd1-a234dfedb58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:55Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Creating volume 7490241e-63c0-4a6c-afd1-a234dfedb58d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:56 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8685b004-933e-4f87-8075-68ffbddf8184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d 1073741824 Sep 25 17:24:56 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36f0d97-4ab3-42db-83fd-7fbe13fc3aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "cinder-quobyte-04128622-3a88-4637-9114-ae8c4a154afe" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Volume volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 (d73f816f-65e7-4714-b94e-bf55ff46c7d0): created successfully Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36f0d97-4ab3-42db-83fd-7fbe13fc3aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (b9e7f847-4ec2-4b3a-bec2-c91dd51fc06b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-04128622-3a88-4637-9114-ae8c4a154afe" acquired by "delete_volume" :: waited 0.050s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:56 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.576s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f4d779a3-ec24-4609-971a-67d1417bb2a0 tempest-ProjectReaderTests-2027106632 None] Created volume successfully. Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3eac0c-1cc4-476e-ac31-40b03f85c35b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:24:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:24:57 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe Sep 25 17:24:57 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:57 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.565s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Deleted volume successfully. Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (c3c396a6-f58b-437e-a955-97d1b28e4f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5e99e-79be-4004-ac98-092a6ce00dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3503bb6c-c149-45b5-b26f-1639d2f484be tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-e47a4424-a8b4-49ae-bbed-018f0d631ba3-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5e99e-79be-4004-ac98-092a6ce00dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-901381046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c6d81c-8dbe-4e12-a6af-5224124d05e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:57Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9fa5de-4676-4b0a-9ff9-67d467e9af85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9fa5de-4676-4b0a-9ff9-67d467e9af85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecff53f-8a0f-46eb-b99f-3c79f1b530a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecff53f-8a0f-46eb-b99f-3c79f1b530a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c6d81c-8dbe-4e12-a6af-5224124d05e9', 'volume_name': 'volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:57 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff0bafe-f3c5-496e-b6cc-a7285e45d03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff0bafe-f3c5-496e-b6cc-a7285e45d03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965c14e5-b16b-4564-94b4-338540fc299d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume b5c6d81c-8dbe-4e12-a6af-5224124d05e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9', 'volume_size': 1} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d 1073741824" returned: 0 in 0.749s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:57 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d Sep 25 17:24:57 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-20bf0934-0619-4a43-b70f-30f0971d7d64-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:57 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe" returned: 0 in 0.741s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-20bf0934-0619-4a43-b70f-30f0971d7d64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.102s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-quobyte-02c5cb6e-386a-40af-8739-0f04fa8fd84c" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:57 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe Sep 25 17:24:57 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-02c5cb6e-386a-40af-8739-0f04fa8fd84c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-quobyte-20bf0934-0619-4a43-b70f-30f0971d7d64" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-20bf0934-0619-4a43-b70f-30f0971d7d64" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Deleting offline snapshot 20bf0934-0619-4a43-b70f-30f0971d7d64 of volume 02c5cb6e-386a-40af-8739-0f04fa8fd84c {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] snapshot_file for this snap is: volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[447488f3-ba1f-4573-9428-ec0762bcd222]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:57 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d" returned: 0 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.905s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031455775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7a20da-369f-4064-9ee4-170063a0b6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:56Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Creating volume 1d7a20da-369f-4064-9ee4-170063a0b6b1 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:57 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:57 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:57 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:24:57 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 1073741824 Sep 25 17:24:57 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:57 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (d4e92465-182b-425a-ab35-4e9b78ee6556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e192cc-21a8-4bd0-a36b-88d9b0902aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-04128622-3a88-4637-9114-ae8c4a154afe" returned: 0 in 0.392s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d557564-b1a9-4276-8d11-bb2670d28ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7490241e-63c0-4a6c-afd1-a234dfedb58d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9f1ba2-f93f-454f-888b-04fab62689c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-04128622-3a88-4637-9114-ae8c4a154afe" released by "delete_volume" :: held 1.274s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e192cc-21a8-4bd0-a36b-88d9b0902aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1290513660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07948a8a-8dd4-439d-ac1a-139a3c0ec4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:58Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3548fad-681d-4107-b991-4b4f269958c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3548fad-681d-4107-b991-4b4f269958c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95cabc21-b5de-4852-8986-80a1b0ddfc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95cabc21-b5de-4852-8986-80a1b0ddfc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07948a8a-8dd4-439d-ac1a-139a3c0ec4f5', 'volume_name': 'volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb846331-32c4-467b-8838-8a0dee9708f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb846331-32c4-467b-8838-8a0dee9708f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32368ff-059b-465b-8124-b864a043edf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume 07948a8a-8dd4-439d-ac1a-139a3c0ec4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5', 'volume_size': 1} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume volume-7490241e-63c0-4a6c-afd1-a234dfedb58d (7490241e-63c0-4a6c-afd1-a234dfedb58d): created successfully Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9f1ba2-f93f-454f-888b-04fab62689c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (1e04ab82-62ea-4c87-802c-f5dfe7753097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7949fab8-d76c-46e6-9c4a-7aaf74af7c6e tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created volume successfully. Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Created reservations ['1e323444-7379-4359-bac9-abad8568907e', 'e918b2c2-30be-49cc-8ba0-ef072c864f1e', '418de1c5-4e4c-45f4-9850-b6b8a9e6bf29', '7cb291b4-d148-4282-bbf1-35ebb5913ca5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:58 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64" returned: 0 in 0.474s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ae0bc7-1944-4e15-b223-0e5a141a5788]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:58 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:24:58 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:58 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c Sep 25 17:24:58 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:58 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 1073741824" returned: 0 in 0.533s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:58 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 Sep 25 17:24:58 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:58 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:24:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Deleted volume successfully. Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da7ff460-e91a-4083-b3d0-483d68102dbe tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-04128622-3a88-4637-9114-ae8c4a154afe-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:58 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c" returned: 0 in 0.501s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:58 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "cinder-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1" returned: 0 in 0.344s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:58 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:58 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.330s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620984116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcc2fe5-0db9-417c-8bf6-c88f41b2756e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:56Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Creating volume 7dcc2fe5-0db9-417c-8bf6-c88f41b2756e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:58 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f13520-e013-41b3-b43b-d8ec49e474a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d7a20da-369f-4064-9ee4-170063a0b6b1', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1089060-5343-49be-b2fe-135b3d424cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:58 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e 1073741824 Sep 25 17:24:58 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:58 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 (1d7a20da-369f-4064-9ee4-170063a0b6b1): created successfully Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1089060-5343-49be-b2fe-135b3d424cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (420b5660-5bd8-48ef-bb8b-186ebb96cd58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fffe3552-2487-4fd8-82c5-ffb218311172 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created volume successfully. Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "cinder-quobyte-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:24:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed050cd0-d233-4802-b44c-4d8c44dae8cf]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:59 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 Sep 25 17:24:59 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:59 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64" returned: 0 in 0.514s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:59 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64 Sep 25 17:24:59 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:59 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e 1073741824" returned: 0 in 0.578s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:59 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e Sep 25 17:24:59 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:59 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:59 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800 Sep 25 17:24:59 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:59 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c.20bf0934-0619-4a43-b70f-30f0971d7d64" returned: 0 in 0.304s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-20bf0934-0619-4a43-b70f-30f0971d7d64" released by "_delete_snapshot" :: held 1.962s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-02c5cb6e-386a-40af-8739-0f04fa8fd84c" released by "delete_snapshot" :: held 1.997s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created reservations ['2cff7ece-2afb-47c3-9394-6c25eb5ab7a1', '976f5982-d855-48c4-a97a-dabe1454bd33', '18b560d4-d2aa-4367-a1a0-ae08f9882250', '328c57b2-518a-4ad3-bcda-2b291b50ff04'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:24:59 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.467s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-901381046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c6d81c-8dbe-4e12-a6af-5224124d05e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:57Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Creating volume b5c6d81c-8dbe-4e12-a6af-5224124d05e9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:24:59 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:24:59 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" returned: 0 in 0.320s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:24:59 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 1073741824 Sep 25 17:24:59 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abec1a1e-3a87-49fc-ab16-88ecde478fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c1c1eb-6b4e-4878-9f27-7696e623ac9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-quobyte-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800" released by "delete_volume" :: held 0.876s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Delete snapshot completed successfully. Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c131ed0f-01bd-4563-bdb1-809a80e234a9 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-20bf0934-0619-4a43-b70f-30f0971d7d64-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:24:59 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e (7dcc2fe5-0db9-417c-8bf6-c88f41b2756e): created successfully Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c1c1eb-6b4e-4878-9f27-7696e623ac9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (5fad3193-b54a-4b02-a827-9decc814d31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:24:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-46f07f15-b30c-4b87-a970-e6a236eb4057 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created volume successfully. Sep 25 17:24:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Created reservations ['d2bb9756-41be-4e21-b844-ac25cbfcf529', '6e6fc8cb-8462-47a0-b81d-344d6b500626', '292e8c32-bca2-4f07-a129-325037e9dafb', '7f6371d2-a949-495f-ba1b-30d0440642ef'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:00 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:00 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:00 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:00 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Deleted volume successfully. Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 1073741824" returned: 0 in 0.547s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-d33aa63a-3923-4f40-9670-57a776ecb163 tempest-VolumeDependencyTests-1867087700 None] Lock "cinder-0804f23b-b07b-4d7e-9d1a-0cbadd6eb800-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:00 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 Sep 25 17:25:00 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:00 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.160s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965c14e5-b16b-4564-94b4-338540fc299d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ab30a6-d006-477b-a260-60e8dc1a8e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Creating offline snapshot 05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 of volume d73f816f-65e7-4714-b94e-bf55ff46c7d0 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:00 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 (b5c6d81c-8dbe-4e12-a6af-5224124d05e9): created successfully Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ab30a6-d006-477b-a260-60e8dc1a8e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (c3c396a6-f58b-437e-a955-97d1b28e4f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a01de0-282e-460f-9b31-a599031a2f5c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-98f697a2-71b6-46b1-bf9e-47dfbefbcd6f tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created volume successfully. Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-02c5cb6e-386a-40af-8739-0f04fa8fd84c-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-02c5cb6e-386a-40af-8739-0f04fa8fd84c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:00 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 Sep 25 17:25:00 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "cinder-quobyte-02c5cb6e-386a-40af-8739-0f04fa8fd84c" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-02c5cb6e-386a-40af-8739-0f04fa8fd84c" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf24ce9-c32f-46b9-bbf7-a5c6740da4a2]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:01 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c Sep 25 17:25:01 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:01 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0" returned: 0 in 0.449s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:01 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 1G Sep 25 17:25:01 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:01 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c" returned: 0 in 0.415s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:01 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c Sep 25 17:25:01 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:01 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-02c5cb6e-386a-40af-8739-0f04fa8fd84c" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:01 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 1G" returned: 0 in 0.530s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-quobyte-02c5cb6e-386a-40af-8739-0f04fa8fd84c" released by "delete_volume" :: held 0.823s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:01 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 Sep 25 17:25:01 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Created reservations ['bd61fbb4-b5c5-4c1a-887a-b47835a02b2a', '5f0a3aaa-4574-4a67-83fb-8680e6619f29', '48ef7cfe-e3e6-4dc4-bc70-bc18865bb8e5', '3b0ef867-e0e1-4a34-92ae-f1e700460cbf'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:01 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:01 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:02 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:02 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 is being set with open permissions: ugo+rw Sep 25 17:25:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:02 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 Sep 25 17:25:02 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:02 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.442s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:02 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Deleted volume successfully. Sep 25 17:25:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-43aefc97-ab74-4939-896e-bed09b1f44d7 tempest-CreateVolumesFromSnapshotTest-1593469740 None] Lock "cinder-02c5cb6e-386a-40af-8739-0f04fa8fd84c-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:02 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2" returned: 0 in 0.334s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:02 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.info Sep 25 17:25:02 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:02 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.info" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:02 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.info is being set with open permissions: ugo+rw Sep 25 17:25:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:02 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.info Sep 25 17:25:02 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:03 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.info" returned: 0 in 0.296s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.189s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1290513660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07948a8a-8dd4-439d-ac1a-139a3c0ec4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3b71ea0a374458820656a4a54b48e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:24:58Z,use_quota=True,user_id='1fc9d02cc39842cfb4114469e93249eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Creating volume 07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:03 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:03 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 1073741824 Sep 25 17:25:03 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9039e2be-74e6-48ce-8a8f-de9df9fc9303 tempest-ProjectReaderTests-2027106632 None] Create snapshot completed successfully Sep 25 17:25:03 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 1073741824" returned: 0 in 0.683s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:04 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 Sep 25 17:25:04 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:04 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32368ff-059b-465b-8124-b864a043edf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d592a29-c9bd-45db-90ec-6b0b1b286a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:04 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Volume volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 (07948a8a-8dd4-439d-ac1a-139a3c0ec4f5): created successfully Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d592a29-c9bd-45db-90ec-6b0b1b286a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Flow 'volume_create_manager' (d4e92465-182b-425a-ab35-4e9b78ee6556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7bda5df8-84d9-42ef-8fea-7c933ba9c482 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created volume successfully. Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-d73f816f-65e7-4714-b94e-bf55ff46c7d0" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-d73f816f-65e7-4714-b94e-bf55ff46c7d0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Deleting offline snapshot 05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 of volume d73f816f-65e7-4714-b94e-bf55ff46c7d0 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] snapshot_file for this snap is: volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc42e5a7-a107-41dd-8542-9bb36f4761a9]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:04 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 Sep 25 17:25:04 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-quobyte-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5" acquired by "delete_volume" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef62f3bb-ef94-48ae-a609-6d918bca74dd]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2" returned: 0 in 0.517s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:05 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 Sep 25 17:25:05 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[28153341-3c9e-4c7b-ae52-e426f2704294]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 Sep 25 17:25:05 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:05 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5" returned: 0 in 0.543s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5 Sep 25 17:25:05 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:05 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0" returned: 0 in 0.642s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:05 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 Sep 25 17:25:05 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:05 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5" returned: 0 in 0.363s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5" released by "delete_volume" :: held 1.090s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Flow 'volume_create_manager' (0bab098f-fa9e-49b5-beec-9cad12996aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e0fe92-5b14-4557-934f-a198971c9d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e0fe92-5b14-4557-934f-a198971c9d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed854e7-9d02-44f3-9a9e-3245e7767dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16caaf343e2449cbab7e163eaa86b89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:06Z,use_quota=True,user_id='0ebd75ef020c4cc58d61941be6bfe24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a37764-4174-4849-93a1-addb1cf78b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a37764-4174-4849-93a1-addb1cf78b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62a877c-8797-4392-aaa2-e4ae41be5022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62a877c-8797-4392-aaa2-e4ae41be5022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed854e7-9d02-44f3-9a9e-3245e7767dcb', 'volume_name': 'volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a644de91-22de-4284-a259-98bf2cc186b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a644de91-22de-4284-a259-98bf2cc186b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ebe9ff-d15c-455c-853b-4a43ec747f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:06 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Volume 9ed854e7-9d02-44f3-9a9e-3245e7767dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb', 'volume_size': 1} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed854e7-9d02-44f3-9a9e-3245e7767dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16caaf343e2449cbab7e163eaa86b89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:06Z,use_quota=True,user_id='0ebd75ef020c4cc58d61941be6bfe24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Creating volume 9ed854e7-9d02-44f3-9a9e-3245e7767dcb {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:06 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:06 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb 1073741824 Sep 25 17:25:06 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created reservations ['9ff9f204-2d2b-432b-a355-a6719ea0ae3c', '9e98efa4-5cf5-4afd-bbd8-e932fbedc150', '20cce69c-4071-4f9f-947d-735bf9ab26e1', '57ec3ff9-ebec-4597-bfc4-3bcbcede9635'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:06 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2" returned: 0 in 0.522s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:06 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:06 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:06 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2 Sep 25 17:25:06 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:06 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.347s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Deleted volume successfully. Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-553356ec-54f7-485d-b733-1a98707d7462 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-07948a8a-8dd4-439d-ac1a-139a3c0ec4f5-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:06 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0.05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2" returned: 0 in 0.384s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:06 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb 1073741824" returned: 0 in 0.600s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2" released by "_delete_snapshot" :: held 2.237s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-d73f816f-65e7-4714-b94e-bf55ff46c7d0" released by "delete_snapshot" :: held 2.282s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:06 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb Sep 25 17:25:06 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Created reservations ['fa9a8ccb-be84-4b58-b6a7-853e7339c934', 'eed6658e-5755-4f1b-a228-938a94709a90', '057230bc-e2ed-4e4b-837b-972bec978818', '793ec644-29f2-43bd-8692-1f9f1e3c5505'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:06 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Delete snapshot completed successfully. Sep 25 17:25:06 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-056e2f86-6d58-415d-8cf2-e0e6b2d8b4d8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-05ef7cd9-f1f9-4b7a-87b5-ed34d540aea2-delete_snapshot" released by "delete_snapshot" :: held 2.499s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:07 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb" returned: 0 in 0.280s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ebe9ff-d15c-455c-853b-4a43ec747f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa27b82-c399-48b8-8541-875f9aa85dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-b5c6d81c-8dbe-4e12-a6af-5224124d05e9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-b5c6d81c-8dbe-4e12-a6af-5224124d05e9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:07 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Volume volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb (9ed854e7-9d02-44f3-9a9e-3245e7767dcb): created successfully Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa27b82-c399-48b8-8541-875f9aa85dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Flow 'volume_create_manager' (0bab098f-fa9e-49b5-beec-9cad12996aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-68e35e40-1d4f-4d13-8b41-eb84540ff15e tempest-CinderUnicodeTest-2040890073 None] Created volume successfully. Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-quobyte-b5c6d81c-8dbe-4e12-a6af-5224124d05e9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-b5c6d81c-8dbe-4e12-a6af-5224124d05e9" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeea3c3-805a-4763-a29a-9eb330bac4b6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:07 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 Sep 25 17:25:07 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:07 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:07 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9 Sep 25 17:25:07 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-d73f816f-65e7-4714-b94e-bf55ff46c7d0-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-d73f816f-65e7-4714-b94e-bf55ff46c7d0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-d73f816f-65e7-4714-b94e-bf55ff46c7d0" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-d73f816f-65e7-4714-b94e-bf55ff46c7d0" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4ed09b-e712-4037-acfe-60f45f57b04b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:07 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-b5c6d81c-8dbe-4e12-a6af-5224124d05e9" returned: 0 in 0.345s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:07 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-b5c6d81c-8dbe-4e12-a6af-5224124d05e9" released by "delete_volume" :: held 0.794s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:08 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 Sep 25 17:25:08 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created reservations ['980afcc8-f835-4828-b6f1-5431b1419571', '0322606d-8085-4d5b-8111-d0d6ad6e0274', 'a7a5c3f5-8f95-4bff-be73-3fe6404908a6', '231aa5d7-2081-41ca-a850-ce4dc6b92e10'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:08 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:08 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:08 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Deleted volume successfully. Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-1873aefa-1dac-46f7-af1e-3e9208ec7e52 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-b5c6d81c-8dbe-4e12-a6af-5224124d05e9-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:08 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0" returned: 0 in 0.684s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:08 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0 Sep 25 17:25:08 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-quobyte-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Flow 'volume_create_manager' (1940607e-186f-458f-acc4-01813cb291f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129133a1-4351-45b3-8ee6-1f3f09b32920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c93a567-d128-4b4c-90ec-0f0fa471f6f4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129133a1-4351-45b3-8ee6-1f3f09b32920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-223527660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e17442-a41f-4710-9aff-2f168b4b7502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16caaf343e2449cbab7e163eaa86b89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:09Z,use_quota=True,user_id='0ebd75ef020c4cc58d61941be6bfe24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a044e68-b464-42e9-942c-bbf4108c8ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a044e68-b464-42e9-942c-bbf4108c8ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17813ad9-77c3-400e-923f-03f416ebcaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17813ad9-77c3-400e-923f-03f416ebcaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e17442-a41f-4710-9aff-2f168b4b7502', 'volume_name': 'volume-77e17442-a41f-4710-9aff-2f168b4b7502', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3feee0c-3ee2-4586-a99b-d06b14939445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3feee0c-3ee2-4586-a99b-d06b14939445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d2a8c7-31fa-45fc-926d-a47afbb81ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Volume 77e17442-a41f-4710-9aff-2f168b4b7502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e17442-a41f-4710-9aff-2f168b4b7502', 'volume_size': 1} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-223527660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e17442-a41f-4710-9aff-2f168b4b7502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16caaf343e2449cbab7e163eaa86b89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:09Z,use_quota=True,user_id='0ebd75ef020c4cc58d61941be6bfe24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Creating volume 77e17442-a41f-4710-9aff-2f168b4b7502 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:08 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:08 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e Sep 25 17:25:08 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 1073741824 Sep 25 17:25:08 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:08 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d73f816f-65e7-4714-b94e-bf55ff46c7d0" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:08 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-d73f816f-65e7-4714-b94e-bf55ff46c7d0" released by "delete_volume" :: held 1.172s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Created reservations ['ff0c7876-5226-44ff-abd0-f0528c4af567', 'd61cb7b9-8b9a-46bb-b3e8-e62745ae9ce4', 'db81382e-7a81-4600-b03c-528dc41ad6c0', '4406bebe-e9de-4e00-8139-018d6f2d4494'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:09 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e" returned: 0 in 0.448s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e Sep 25 17:25:09 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Deleted volume successfully. Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-796e690b-70ca-4d14-935b-c0ef68a5fbc8 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-d73f816f-65e7-4714-b94e-bf55ff46c7d0-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:09 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 1073741824" returned: 0 in 0.655s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e" returned: 0 in 0.328s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e" released by "delete_volume" :: held 0.878s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 Sep 25 17:25:09 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created reservations ['2d6300c5-a58b-4716-b219-2cced933925c', '825a6b83-a1d2-48f3-9c7d-3bc7fd6d2bc8', '0c14c456-7655-4a79-bb24-a651a5a2abe1', '0836b68e-71d8-4519-aa78-d13ce08509ce'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:09 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:09 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:09 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502" returned: 0 in 0.324s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Flow 'volume_create_manager' (6ebd4220-a88b-45e1-981d-09a360453cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22c7b89-1d6a-43f4-ae28-4e87e4f9d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d2a8c7-31fa-45fc-926d-a47afbb81ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e17442-a41f-4710-9aff-2f168b4b7502', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce6d4d6-eabe-44e5-a3fd-4793e50f8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Volume volume-77e17442-a41f-4710-9aff-2f168b4b7502 (77e17442-a41f-4710-9aff-2f168b4b7502): created successfully Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce6d4d6-eabe-44e5-a3fd-4793e50f8074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Flow 'volume_create_manager' (1940607e-186f-458f-acc4-01813cb291f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22c7b89-1d6a-43f4-ae28-4e87e4f9d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e420696-9f93-461a-9886-18e4af88e95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fe169485ca4e7ab7a120e1c74b3dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:10Z,use_quota=True,user_id='365bc2c6cc9a43deb9abf8664eb4b2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d0b33a-0697-4335-8540-6f87ac11ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d0b33a-0697-4335-8540-6f87ac11ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a89b88-35e2-4992-af48-e394a757c6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.image.glance [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Creating Keystone auth plugin from conf {{(pid=87232) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 17:25:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-85157ebf-5e66-4899-b8e0-62fa6688fcd4 tempest-CinderUnicodeTest-2040890073 None] Created volume successfully. Sep 25 17:25:10 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.291s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Deleted volume successfully. Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-895a7e27-ad41-4e6b-8ab1-eb6300d3a994 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-7dcc2fe5-0db9-417c-8bf6-c88f41b2756e-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a89b88-35e2-4992-af48-e394a757c6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e420696-9f93-461a-9886-18e4af88e95f', 'volume_name': 'volume-7e420696-9f93-461a-9886-18e4af88e95f', 'volume_size': 1, 'image_id': '7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4cea98e4df3b9f9755df72938665595e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2fe169485ca4e7ab7a120e1c74b3dc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8cabb3b039a39fb2ca16ef285e0714be6d9030016740414ef2f36cb6d1f663fc590bd42a8e259cf44c79da23315f96c93bc9269815c1a63f8a7e303938c765e', 'id': '7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'created_at': datetime.datetime(2026, 9, 25, 15, 25, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 25, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d29e6d3-3257-4f9c-9562-95151e57f2c2/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6b8a13-3412-46d1-939b-5d9ba161e98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6b8a13-3412-46d1-939b-5d9ba161e98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e19ea4-74b9-49ec-b311-2166fd50c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Volume 7e420696-9f93-461a-9886-18e4af88e95f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e420696-9f93-461a-9886-18e4af88e95f', 'volume_size': 1, 'image_id': '7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4cea98e4df3b9f9755df72938665595e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2fe169485ca4e7ab7a120e1c74b3dc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8cabb3b039a39fb2ca16ef285e0714be6d9030016740414ef2f36cb6d1f663fc590bd42a8e259cf44c79da23315f96c93bc9269815c1a63f8a7e303938c765e', 'id': '7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'created_at': datetime.datetime(2026, 9, 25, 15, 25, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 25, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d29e6d3-3257-4f9c-9562-95151e57f2c2/file', 'properties': {}}, 'image_service': } Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Trying to clone 7e420696-9f93-461a-9886-18e4af88e95f from image 7d29e6d3-3257-4f9c-9562-95151e57f2c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'metadata': {}}]). {{(pid=87232) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 17:25:10 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Image download 0.00 MB at 0.00 MB/s Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4da5c97-0e83-4ab4-994e-4620a3ff0726]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:10 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD Sep 25 17:25:10 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (98ac364b-98ad-450f-b9d5-d2afb8651f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4dcb56-c122-43b6-a852-b3a1b5312885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4dcb56-c122-43b6-a852-b3a1b5312885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-635623692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c206d64f-9e40-4797-8afc-bb269ae09619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:11Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7900b75d-bff3-47bc-b0a5-62e3004e800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7900b75d-bff3-47bc-b0a5-62e3004e800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f135151e-e717-40a8-a7c1-269e251dfd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f135151e-e717-40a8-a7c1-269e251dfd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c206d64f-9e40-4797-8afc-bb269ae09619', 'volume_name': 'volume-c206d64f-9e40-4797-8afc-bb269ae09619', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e54027-9477-43f4-ad06-f673119de70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e54027-9477-43f4-ad06-f673119de70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe8183e-0d5a-4882-ac0d-6b8b7a255832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:10 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Volume c206d64f-9e40-4797-8afc-bb269ae09619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c206d64f-9e40-4797-8afc-bb269ae09619', 'volume_size': 1} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-635623692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c206d64f-9e40-4797-8afc-bb269ae09619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:11Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Creating volume c206d64f-9e40-4797-8afc-bb269ae09619 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:10 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:10 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 1073741824 Sep 25 17:25:10 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:10 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-1d7a20da-369f-4064-9ee4-170063a0b6b1-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-1d7a20da-369f-4064-9ee4-170063a0b6b1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-quobyte-1d7a20da-369f-4064-9ee4-170063a0b6b1" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-1d7a20da-369f-4064-9ee4-170063a0b6b1" acquired by "delete_volume" :: waited 0.031s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3a6fff-5636-4221-ad64-0658dff81ae5]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:11 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD Sep 25 17:25:11 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:11 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 Sep 25 17:25:11 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:11 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 1073741824" returned: 0 in 0.642s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:11 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD" returned: 1 in 0.492s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Temporary image 7d29e6d3-3257-4f9c-9562-95151e57f2c2 is fetched for user 365bc2c6cc9a43deb9abf8664eb4b2ac. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 17:25:11 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 Sep 25 17:25:11 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48a0c90-0658-4619-af6a-788f6affa00b]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:11 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1" returned: 0 in 0.429s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:11 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1 Sep 25 17:25:11 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:11 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD Sep 25 17:25:11 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:11 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.508s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Creating offline snapshot 0ca64b27-bcc4-4a25-abab-9e554c59c9d0 of volume 77e17442-a41f-4710-9aff-2f168b4b7502 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe8183e-0d5a-4882-ac0d-6b8b7a255832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c206d64f-9e40-4797-8afc-bb269ae09619', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cd9438-e449-4d85-9d99-cf9fabb9a10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c9c4ee-1497-40ce-9361-a583d73691d2]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Volume volume-c206d64f-9e40-4797-8afc-bb269ae09619 (c206d64f-9e40-4797-8afc-bb269ae09619): created successfully Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cd9438-e449-4d85-9d99-cf9fabb9a10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (98ac364b-98ad-450f-b9d5-d2afb8651f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:11 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-60b5f7a6-0a15-48fc-848b-b2c48f815540 tempest-ProjectReaderTests-2027106632 None] Created volume successfully. Sep 25 17:25:11 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 Sep 25 17:25:11 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:11 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:11 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-1d7a20da-369f-4064-9ee4-170063a0b6b1" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-1d7a20da-369f-4064-9ee4-170063a0b6b1" released by "delete_volume" :: held 0.862s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created reservations ['c2735b33-87d4-4cac-90af-ee939dca2a85', '312162b3-4538-45dd-a630-61245caa8b84', '104d5487-0f46-4ffa-ab61-d961df1d7111', 'd7ef0834-5605-445a-852f-cac739b99723'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:12 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD Sep 25 17:25:12 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:12 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-7490241e-63c0-4a6c-afd1-a234dfedb58d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-7490241e-63c0-4a6c-afd1-a234dfedb58d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:12 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502" returned: 0 in 0.528s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 1G Sep 25 17:25:12 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-quobyte-7490241e-63c0-4a6c-afd1-a234dfedb58d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:12 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-7490241e-63c0-4a6c-afd1-a234dfedb58d" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a92de1-b496-4c67-a0c0-b114a6d34441]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Deleted volume successfully. Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-030ea705-f371-481b-a3cb-ddb1e5745e58 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-1d7a20da-369f-4064-9ee4-170063a0b6b1-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:12 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d Sep 25 17:25:12 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 1G" returned: 0 in 0.575s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e17442-a41f-4710-9aff-2f168b4b7502 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d" returned: 0 in 0.483s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:12 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d Sep 25 17:25:12 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:12 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e17442-a41f-4710-9aff-2f168b4b7502 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 Sep 25 17:25:12 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:13 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e17442-a41f-4710-9aff-2f168b4b7502 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:13 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 is being set with open permissions: ugo+rw Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:13 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7490241e-63c0-4a6c-afd1-a234dfedb58d" returned: 0 in 0.381s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:13 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 Sep 25 17:25:13 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-7490241e-63c0-4a6c-afd1-a234dfedb58d" released by "delete_volume" :: held 0.925s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created reservations ['642ec012-7645-4b51-93c2-404994227d95', '0074154a-a1e0-4366-accb-17a8946e53a7', '269d1798-b42a-4c7d-bfde-946c3fcacf67', 'e1f3b888-e70f-42ce-a468-885a52787205'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:13 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:13 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:13 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0" returned: 0 in 0.275s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:13 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.info Sep 25 17:25:13 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:13 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Deleted volume successfully. Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7bd6e2e4-e144-47c2-848f-5be59d8132d0 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-7490241e-63c0-4a6c-afd1-a234dfedb58d-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:13 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.info" returned: 0 in 0.268s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:13 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.info is being set with open permissions: ugo+rw Sep 25 17:25:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:13 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.info Sep 25 17:25:13 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:14 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.info" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.758s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e420696-9f93-461a-9886-18e4af88e95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fe169485ca4e7ab7a120e1c74b3dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:10Z,use_quota=True,user_id='365bc2c6cc9a43deb9abf8664eb4b2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Creating volume 7e420696-9f93-461a-9886-18e4af88e95f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:14 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:14 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f 1073741824 Sep 25 17:25:14 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3ad724c4-0f17-4368-a6cf-35f2d8c1c917 tempest-CinderUnicodeTest-2040890073 None] Create snapshot completed successfully Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "cinder-0ca64b27-bcc4-4a25-abab-9e554c59c9d0-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-0ca64b27-bcc4-4a25-abab-9e554c59c9d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "cinder-quobyte-77e17442-a41f-4710-9aff-2f168b4b7502" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-quobyte-77e17442-a41f-4710-9aff-2f168b4b7502" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "cinder-quobyte-0ca64b27-bcc4-4a25-abab-9e554c59c9d0" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-quobyte-0ca64b27-bcc4-4a25-abab-9e554c59c9d0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Deleting offline snapshot 0ca64b27-bcc4-4a25-abab-9e554c59c9d0 of volume 77e17442-a41f-4710-9aff-2f168b4b7502 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] snapshot_file for this snap is: volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a509683a-8047-4419-a6f5-1e3067bf11ba]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-d6f731d7-138a-44c8-a597-d32fbfecc328-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-d6f731d7-138a-44c8-a597-d32fbfecc328-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "cinder-quobyte-d6f731d7-138a-44c8-a597-d32fbfecc328" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-d6f731d7-138a-44c8-a597-d32fbfecc328" acquired by "delete_volume" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:14 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 Sep 25 17:25:14 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8420b8-a1fb-4720-a2f9-4d9c3289c742]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:14 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f 1073741824" returned: 0 in 0.612s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:14 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328 Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:14 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:14 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f Sep 25 17:25:14 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:14 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0" returned: 0 in 0.492s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e17442-a41f-4710-9aff-2f168b4b7502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4553c34-4cb2-42d0-884c-7eefa036dbcc]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f" returned: 0 in 0.299s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.068s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328" returned: 0 in 0.435s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328 Sep 25 17:25:15 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Creating offline snapshot 6c98e130-83a4-4018-9030-7d8538b01122 of volume c206d64f-9e40-4797-8afc-bb269ae09619 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:15 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 Sep 25 17:25:15 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Attempting download of 7d29e6d3-3257-4f9c-9562-95151e57f2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'metadata': {}}])) to volume 7e420696-9f93-461a-9886-18e4af88e95f. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb76dca-9f55-4268-94cf-8a46f4aaac8e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99dce67-8ea7-473b-88a9-d195f1b75d54]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d29e6d3-3257-4f9c-9562-95151e57f2c2_v21pd7_k {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 Sep 25 17:25:15 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-d6f731d7-138a-44c8-a597-d32fbfecc328" returned: 0 in 0.294s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-quobyte-d6f731d7-138a-44c8-a597-d32fbfecc328" released by "delete_volume" :: held 0.779s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:15 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d29e6d3-3257-4f9c-9562-95151e57f2c2_v21pd7_k Sep 25 17:25:15 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Created reservations ['b2d40cd5-b359-4f72-836f-823a0c4ded22', 'e681177d-63d3-4663-8476-0fffbaae673a', '43ff6642-7630-41a5-a339-cfdd9c2b9e9c', '36825a81-67a0-4348-818e-978964f4f4b1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:15 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502" returned: 0 in 0.506s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 Sep 25 17:25:15 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:15 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619" returned: 0 in 0.492s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d29e6d3-3257-4f9c-9562-95151e57f2c2_v21pd7_k" returned: 0 in 0.461s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d29e6d3-3257-4f9c-9562-95151e57f2c2_v21pd7_k {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:15 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 1G Sep 25 17:25:15 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.338s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:15 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d29e6d3-3257-4f9c-9562-95151e57f2c2_v21pd7_k Sep 25 17:25:15 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Deleted volume successfully. Sep 25 17:25:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c9d62761-5480-4942-a5fb-952ad74cccc9 tempest-CreateVolumesFromSourceVolumeTest-1935158946 None] Lock "cinder-d6f731d7-138a-44c8-a597-d32fbfecc328-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:16 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0" returned: 0 in 0.597s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:16 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0 Sep 25 17:25:16 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:16 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d29e6d3-3257-4f9c-9562-95151e57f2c2_v21pd7_k" returned: 1 in 0.508s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d29e6d3-3257-4f9c-9562-95151e57f2c2_v21pd7_k' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[537ff07b-8012-43ba-a404-ae1093355b64]: (4, 'raw') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:16 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 1G" returned: 0 in 0.614s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c206d64f-9e40-4797-8afc-bb269ae09619 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:16 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c206d64f-9e40-4797-8afc-bb269ae09619 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 Sep 25 17:25:16 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:16 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD Sep 25 17:25:16 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:16 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502.0ca64b27-bcc4-4a25-abab-9e554c59c9d0" returned: 0 in 0.328s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-quobyte-0ca64b27-bcc4-4a25-abab-9e554c59c9d0" released by "_delete_snapshot" :: held 2.087s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-quobyte-77e17442-a41f-4710-9aff-2f168b4b7502" released by "delete_snapshot" :: held 2.122s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:16 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Created reservations ['76188192-b05c-4779-b7b3-d625014c6773', 'ca9950df-3630-488a-b4ca-04306fbf939e', 'b595a386-4f26-44ec-90e7-e2eb9700ea36', '24c06508-89a8-4188-a06c-a94af8e8584a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:16 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c206d64f-9e40-4797-8afc-bb269ae09619 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122" returned: 0 in 0.431s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 is being set with open permissions: ugo+rw Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:16 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD Sep 25 17:25:16 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:16 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 Sep 25 17:25:16 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Delete snapshot completed successfully. Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-c7a84c12-6b8e-4cc9-ab5d-66d3ed25c07c tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-0ca64b27-bcc4-4a25-abab-9e554c59c9d0-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:16 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] 7d29e6d3-3257-4f9c-9562-95151e57f2c2 was raw, converting to qcow2 {{(pid=87232) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 17:25:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:17 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f Sep 25 17:25:17 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:17 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122" returned: 0 in 0.292s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:17 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.info Sep 25 17:25:17 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:17 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.info" returned: 0 in 0.362s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:17 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.info is being set with open permissions: ugo+rw Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:17 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.info Sep 25 17:25:17 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:17 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f" returned: 0 in 0.628s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d29e6d3-3257-4f9c-9562-95151e57f2c2_o35vq43ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:25:17 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:17 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f 1G Sep 25 17:25:17 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "cinder-77e17442-a41f-4710-9aff-2f168b4b7502-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-77e17442-a41f-4710-9aff-2f168b4b7502-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:17 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.info" returned: 0 in 0.350s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.726s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "cinder-quobyte-77e17442-a41f-4710-9aff-2f168b4b7502" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:17 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9721a2d0-f765-486a-9c8e-f4d9ec0e033b tempest-ProjectReaderTests-2027106632 None] Create snapshot completed successfully Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-quobyte-77e17442-a41f-4710-9aff-2f168b4b7502" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ea2e3f-4ce5-4bf7-bd1e-dafb72aadcd6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:18 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f 1G" returned: 0 in 0.400s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Downloaded image 7d29e6d3-3257-4f9c-9562-95151e57f2c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'metadata': {}}])) to volume 7e420696-9f93-461a-9886-18e4af88e95f successfully. {{(pid=87232) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Temporary image 7d29e6d3-3257-4f9c-9562-95151e57f2c2 for user 365bc2c6cc9a43deb9abf8664eb4b2ac is deleted. {{(pid=87232) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.volume_utils [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Marking volume 7e420696-9f93-461a-9886-18e4af88e95f as bootable. {{(pid=87232) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Copying metadata from image 7d29e6d3-3257-4f9c-9562-95151e57f2c2 to 7e420696-9f93-461a-9886-18e4af88e95f. {{(pid=87232) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Creating volume glance metadata for volume 7e420696-9f93-461a-9886-18e4af88e95f backed by image 7d29e6d3-3257-4f9c-9562-95151e57f2c2 with: {'image_id': '7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4cea98e4df3b9f9755df72938665595e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87232) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 17:25:18 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 Sep 25 17:25:18 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e19ea4-74b9-49ec-b311-2166fd50c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e420696-9f93-461a-9886-18e4af88e95f', 'volume_size': 1, 'image_id': '7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4cea98e4df3b9f9755df72938665595e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2fe169485ca4e7ab7a120e1c74b3dc2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a8cabb3b039a39fb2ca16ef285e0714be6d9030016740414ef2f36cb6d1f663fc590bd42a8e259cf44c79da23315f96c93bc9269815c1a63f8a7e303938c765e', 'id': '7d29e6d3-3257-4f9c-9562-95151e57f2c2', 'created_at': datetime.datetime(2026, 9, 25, 15, 25, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 15, 25, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d29e6d3-3257-4f9c-9562-95151e57f2c2/file', 'properties': {}}, 'image_service': }' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6473dcab-a878-416f-a80c-242d82ece8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:18 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Volume volume-7e420696-9f93-461a-9886-18e4af88e95f (7e420696-9f93-461a-9886-18e4af88e95f): created successfully Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6473dcab-a878-416f-a80c-242d82ece8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Flow 'volume_create_manager' (6ebd4220-a88b-45e1-981d-09a360453cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:18 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9ac81ac2-c1fc-46a4-b40b-1a5f4bb95018 tempest-VolumeImageDependencyTests-903499263 None] Created volume successfully. Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-6c98e130-83a4-4018-9030-7d8538b01122-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-6c98e130-83a4-4018-9030-7d8538b01122-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-c206d64f-9e40-4797-8afc-bb269ae09619" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-c206d64f-9e40-4797-8afc-bb269ae09619" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-6c98e130-83a4-4018-9030-7d8538b01122" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-6c98e130-83a4-4018-9030-7d8538b01122" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Deleting offline snapshot 6c98e130-83a4-4018-9030-7d8538b01122 of volume c206d64f-9e40-4797-8afc-bb269ae09619 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] snapshot_file for this snap is: volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb853d-7ad0-4e3e-ac9c-37c5e525cda9]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:18 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502" returned: 0 in 0.477s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:18 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502 Sep 25 17:25:18 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:18 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 Sep 25 17:25:18 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Acquiring lock "cinder-7e420696-9f93-461a-9886-18e4af88e95f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Lock "cinder-7e420696-9f93-461a-9886-18e4af88e95f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Acquiring lock "cinder-quobyte-7e420696-9f93-461a-9886-18e4af88e95f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Lock "cinder-quobyte-7e420696-9f93-461a-9886-18e4af88e95f" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed432da-4585-4851-b307-0453a7171e8e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:18 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-77e17442-a41f-4710-9aff-2f168b4b7502" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-quobyte-77e17442-a41f-4710-9aff-2f168b4b7502" released by "delete_volume" :: held 0.943s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Created reservations ['e148c417-89ea-4bb5-9001-01359efdbb7a', 'a8ce87bb-733b-4c14-98e9-e4df48cf1368', '186c1848-358a-41d0-bbe4-fbdc082589b8', 'f3781793-ecc9-42ce-ad29-2a01caf9c101'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:18 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122" returned: 0 in 0.550s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c206d64f-9e40-4797-8afc-bb269ae09619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:18 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f Sep 25 17:25:18 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c46c521-0dd9-4717-99b9-bc5e3694cbab]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:19 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 Sep 25 17:25:19 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:19 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:19 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:19 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f" returned: 0 in 0.482s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:19 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f Sep 25 17:25:19 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:19 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619" returned: 0 in 0.491s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:19 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 Sep 25 17:25:19 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:19 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.360s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Deleted volume successfully. Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-de95e18c-2c02-4360-9d83-6408bb03e7e2 tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-77e17442-a41f-4710-9aff-2f168b4b7502-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:19 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-7e420696-9f93-461a-9886-18e4af88e95f" returned: 0 in 0.316s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Lock "cinder-quobyte-7e420696-9f93-461a-9886-18e4af88e95f" released by "delete_volume" :: held 0.869s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Created reservations ['10e3b0f3-aec7-4302-a4cf-32f6af1a3a8e', '61cfb315-f3f5-4a3e-ab17-e65082e1a4b2', '4677c44c-dc6c-466f-9895-e4fee9cc4a69', '4a110153-5c10-4d6d-9d79-355479dc3058'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:19 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:19 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:19 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122" returned: 0 in 0.517s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:20 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122 Sep 25 17:25:20 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "cinder-9ed854e7-9d02-44f3-9a9e-3245e7767dcb-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:20 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.364s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Deleted volume successfully. Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-9ed854e7-9d02-44f3-9a9e-3245e7767dcb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=296,cinder:SELECT=205,cinder:DELETE=28,cinder:INSERT=87 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=226,cinder:UPDATE=288,cinder:INSERT=70,cinder:DELETE=25 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e2ba780-7671-4b30-8b64-c7577ab8691f tempest-VolumeImageDependencyTests-903499263 None] Lock "cinder-7e420696-9f93-461a-9886-18e4af88e95f-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "cinder-quobyte-9ed854e7-9d02-44f3-9a9e-3245e7767dcb" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-quobyte-9ed854e7-9d02-44f3-9a9e-3245e7767dcb" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[48227ee0-ca27-47f8-a416-f8b82af49174]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:20 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619.6c98e130-83a4-4018-9030-7d8538b01122" returned: 0 in 0.408s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-6c98e130-83a4-4018-9030-7d8538b01122" released by "_delete_snapshot" :: held 2.101s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-c206d64f-9e40-4797-8afc-bb269ae09619" released by "delete_snapshot" :: held 2.143s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:20 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb Sep 25 17:25:20 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Created reservations ['d4b80ce4-fe47-4b8f-bdd9-b22aac307fd1', '090551ba-aadd-4f19-a499-f22d2826eb9b', 'c9709936-6349-4708-bfa0-94f547a78314', 'a4807463-0f1a-4210-8c8d-0e883af20f1e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:20 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Delete snapshot completed successfully. Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f13d8fc7-3a84-404c-8eea-71f080333540 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-6c98e130-83a4-4018-9030-7d8538b01122-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:20 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb" returned: 0 in 0.500s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:20 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:20 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb Sep 25 17:25:20 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:21 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9ed854e7-9d02-44f3-9a9e-3245e7767dcb" returned: 0 in 0.310s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-quobyte-9ed854e7-9d02-44f3-9a9e-3245e7767dcb" released by "delete_volume" :: held 0.865s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Created reservations ['8a1e345f-9acf-468b-bb4d-826d493b0513', 'df269def-ded0-47e6-97bc-e904d2d5ab98', '24b54d05-99d9-4df7-89b5-3ac0dff69b33', 'ba9ea1ad-0bc7-4d5e-8aba-30d90a8ccc75'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:21 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:21 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-c206d64f-9e40-4797-8afc-bb269ae09619-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-c206d64f-9e40-4797-8afc-bb269ae09619-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:21 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.403s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:21 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Deleted volume successfully. Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-a94d1ff2-68bc-4b74-b620-e725c7a98ba4 tempest-CinderUnicodeTest-2040890073 None] Lock "cinder-9ed854e7-9d02-44f3-9a9e-3245e7767dcb-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-c206d64f-9e40-4797-8afc-bb269ae09619" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-c206d64f-9e40-4797-8afc-bb269ae09619" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f106ac-c8dd-4efc-80d7-f03c2471e2ca]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:22 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 Sep 25 17:25:22 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:22 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619" returned: 0 in 0.469s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:22 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619 Sep 25 17:25:22 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:22 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c206d64f-9e40-4797-8afc-bb269ae09619" returned: 0 in 0.500s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-c206d64f-9e40-4797-8afc-bb269ae09619" released by "delete_volume" :: held 1.093s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Created reservations ['7346e3a4-d4c7-49c5-bbf7-1692e0b5cd4f', '1591ba4e-f135-4e5c-a67e-a1ac10760b41', '5b1d08ea-84fa-4b51-8d17-d0467a327370', 'b406d8dd-5179-4c39-becc-d2bcc2c109d0'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:23 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:23 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:23 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:23 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Deleted volume successfully. Sep 25 17:25:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e1fbb64-6b2c-4f66-81ff-4052d0f7e181 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-c206d64f-9e40-4797-8afc-bb269ae09619-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (242251a8-677f-4e51-a435-e155569803fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85999b5a-dd50-4049-972d-25aa5801bce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85999b5a-dd50-4049-972d-25aa5801bce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-563954581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee88959-40b3-451f-96a2-a07b0ad2c495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:24Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc66423-aed2-43b7-b858-2eee2d201956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc66423-aed2-43b7-b858-2eee2d201956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c985dc-cc5a-4ad1-8f47-78a5bb2b52e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c985dc-cc5a-4ad1-8f47-78a5bb2b52e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee88959-40b3-451f-96a2-a07b0ad2c495', 'volume_name': 'volume-2ee88959-40b3-451f-96a2-a07b0ad2c495', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8ec4bf-5d5c-456d-9c64-176f7c749a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8ec4bf-5d5c-456d-9c64-176f7c749a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45976c2c-4843-45b7-a250-7876c98071b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Volume 2ee88959-40b3-451f-96a2-a07b0ad2c495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee88959-40b3-451f-96a2-a07b0ad2c495', 'volume_size': 1} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-563954581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee88959-40b3-451f-96a2-a07b0ad2c495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:24Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Creating volume 2ee88959-40b3-451f-96a2-a07b0ad2c495 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:24 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:24 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 1073741824 Sep 25 17:25:24 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-aa3c762e-5597-4d11-9fa2-4c741fa842a0 tempest-ProjectAdminTests-812796911 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.302547454834, 'free_capacity_gb': 1775.302547454834, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87232) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 17:25:25 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 1073741824" returned: 0 in 0.589s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:25 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 Sep 25 17:25:25 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:25 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495" returned: 0 in 0.314s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45976c2c-4843-45b7-a250-7876c98071b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee88959-40b3-451f-96a2-a07b0ad2c495', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dab7546-4244-4959-83f7-2996a6f7fdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Volume volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 (2ee88959-40b3-451f-96a2-a07b0ad2c495): created successfully Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dab7546-4244-4959-83f7-2996a6f7fdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (242251a8-677f-4e51-a435-e155569803fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9e25b6a2-653c-4694-ab04-2bcd46b8a09c tempest-ProjectReaderTests-2027106632 None] Created volume successfully. Sep 25 17:25:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Creating offline snapshot d5b04da0-7cd3-4543-ba76-dd1a419d19a1 of volume 2ee88959-40b3-451f-96a2-a07b0ad2c495 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8997c4-0528-400a-877d-5e79d602f26f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:27 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 Sep 25 17:25:27 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:27 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495" returned: 0 in 0.535s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:27 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 1G Sep 25 17:25:27 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:28 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 1G" returned: 0 in 0.542s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:28 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 Sep 25 17:25:28 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:28 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:28 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 is being set with open permissions: ugo+rw Sep 25 17:25:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:28 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 Sep 25 17:25:28 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:28 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:28 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.info Sep 25 17:25:28 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:29 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.info" returned: 0 in 0.333s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:29 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.info is being set with open permissions: ugo+rw Sep 25 17:25:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:29 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.info Sep 25 17:25:29 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:29 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.info" returned: 0 in 0.286s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.556s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-23f8b564-8501-4eec-8bf8-fd27ce6d5e67 tempest-ProjectReaderTests-2027106632 None] Create snapshot completed successfully Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-d5b04da0-7cd3-4543-ba76-dd1a419d19a1-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-d5b04da0-7cd3-4543-ba76-dd1a419d19a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-2ee88959-40b3-451f-96a2-a07b0ad2c495" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-2ee88959-40b3-451f-96a2-a07b0ad2c495" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-d5b04da0-7cd3-4543-ba76-dd1a419d19a1" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-d5b04da0-7cd3-4543-ba76-dd1a419d19a1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Deleting offline snapshot d5b04da0-7cd3-4543-ba76-dd1a419d19a1 of volume 2ee88959-40b3-451f-96a2-a07b0ad2c495 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] snapshot_file for this snap is: volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a47485-e22b-4387-a8c7-0201dc9ec1fe]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:30 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 Sep 25 17:25:30 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:31 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1" returned: 0 in 0.475s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:31 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee88959-40b3-451f-96a2-a07b0ad2c495(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:31 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaedea6a-5ea6-420d-a2b9-4d8ad0a7d97a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:31 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 Sep 25 17:25:31 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:31 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495" returned: 0 in 0.515s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:31 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 Sep 25 17:25:31 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:32 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1" returned: 0 in 0.444s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:32 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1 Sep 25 17:25:32 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Flow 'volume_create_manager' (b7039fcd-211b-4b47-8556-9772827d63e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a8a413-f7ea-474c-a8ac-63b1fb265c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a8a413-f7ea-474c-a8ac-63b1fb265c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324932560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd47eca-4a8d-499a-aaf2-3ab49e989b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ece37d62274666a2ca3ebd6fd4355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:32Z,use_quota=True,user_id='6c50d2173acf48cba8a8e7e9b784afbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e83b37c-06cb-45c6-9f76-4c9d622531e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e83b37c-06cb-45c6-9f76-4c9d622531e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8c8a2b-ce8f-428e-841b-a683ee535265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8c8a2b-ce8f-428e-841b-a683ee535265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd47eca-4a8d-499a-aaf2-3ab49e989b36', 'volume_name': 'volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe4a4a2-963b-41c6-8e8f-84f24f9ec2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe4a4a2-963b-41c6-8e8f-84f24f9ec2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8207c7-2c29-4f12-9d62-110a49a22bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:32 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Volume 9bd47eca-4a8d-499a-aaf2-3ab49e989b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36', 'volume_size': 1} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324932560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd47eca-4a8d-499a-aaf2-3ab49e989b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ece37d62274666a2ca3ebd6fd4355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:32Z,use_quota=True,user_id='6c50d2173acf48cba8a8e7e9b784afbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Creating volume 9bd47eca-4a8d-499a-aaf2-3ab49e989b36 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:32 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:32 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 1073741824 Sep 25 17:25:32 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:32 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495.d5b04da0-7cd3-4543-ba76-dd1a419d19a1" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-d5b04da0-7cd3-4543-ba76-dd1a419d19a1" released by "_delete_snapshot" :: held 1.882s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-2ee88959-40b3-451f-96a2-a07b0ad2c495" released by "delete_snapshot" :: held 1.918s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Created reservations ['d5ac0469-8ecc-4a58-ac6a-32f3dad76585', '47a43af5-2a51-431a-9b10-358b43b5b2f5', 'd82a0adf-efe1-45de-87cc-53a74cf13ffe', '97aeae63-9a9d-4b60-85b2-d2d908b29d15'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Delete snapshot completed successfully. Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f69bdf06-b205-4efa-881f-fafeab3b3f97 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-d5b04da0-7cd3-4543-ba76-dd1a419d19a1-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-2ee88959-40b3-451f-96a2-a07b0ad2c495-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Lock "cinder-2ee88959-40b3-451f-96a2-a07b0ad2c495-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-2ee88959-40b3-451f-96a2-a07b0ad2c495" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-2ee88959-40b3-451f-96a2-a07b0ad2c495" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbe94ec-777a-486f-b543-f8cd4e0265ed]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:33 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 1073741824" returned: 0 in 0.626s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:33 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 Sep 25 17:25:33 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:33 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 Sep 25 17:25:33 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:33 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36" returned: 0 in 0.308s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8207c7-2c29-4f12-9d62-110a49a22bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4607f143-43b6-442f-9168-17ba865cf030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:33 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Volume volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 (9bd47eca-4a8d-499a-aaf2-3ab49e989b36): created successfully Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4607f143-43b6-442f-9168-17ba865cf030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Flow 'volume_create_manager' (b7039fcd-211b-4b47-8556-9772827d63e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-907c8968-c02d-4b6e-8e4d-98275c2accde tempest-ProjectReaderTests-1783291108 None] Created volume successfully. Sep 25 17:25:33 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495" returned: 0 in 0.509s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:33 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495 Sep 25 17:25:33 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:33 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-2ee88959-40b3-451f-96a2-a07b0ad2c495" returned: 0 in 0.337s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-2ee88959-40b3-451f-96a2-a07b0ad2c495" released by "delete_volume" :: held 0.919s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Created reservations ['53e131cd-6ed5-48d7-943c-7eb42146305e', '7dccc3f3-dcf6-4b4d-83c9-26031816bdb2', '6561a122-4b82-4a78-abf0-1d3866a2f0a3', '0c4c7864-df5f-45db-aab6-9c3849401952'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:34 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:34 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:34 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.480s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:34 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Deleted volume successfully. Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (b8f358b3-e347-4fd0-8a75-62348922d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bd916a-76c8-4de5-a64c-3269cc79335c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-2e169ede-8261-469d-a354-ad0eb1abb95e tempest-ProjectReaderTests-2027106632 None] Lock "cinder-2ee88959-40b3-451f-96a2-a07b0ad2c495-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bd916a-76c8-4de5-a64c-3269cc79335c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862571312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c583b4cc-a5c4-494c-858c-6bcbdaadce9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:35Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bed995-5935-4ae5-bcde-c62e2baf1744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bed995-5935-4ae5-bcde-c62e2baf1744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f964183c-5605-4b69-bfd4-3dca3cbcf679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f964183c-5605-4b69-bfd4-3dca3cbcf679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c583b4cc-a5c4-494c-858c-6bcbdaadce9d', 'volume_name': 'volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87eb213-f109-477d-a394-e4fd52c783f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87eb213-f109-477d-a394-e4fd52c783f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a057fd-7a5c-4d3e-87d2-0a57589a37d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Volume c583b4cc-a5c4-494c-858c-6bcbdaadce9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d', 'volume_size': 1} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862571312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c583b4cc-a5c4-494c-858c-6bcbdaadce9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:35Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Creating volume c583b4cc-a5c4-494c-858c-6bcbdaadce9d {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:34 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Acquiring lock "cinder-9bd47eca-4a8d-499a-aaf2-3ab49e989b36-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:34 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d 1073741824 Sep 25 17:25:34 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Lock "cinder-9bd47eca-4a8d-499a-aaf2-3ab49e989b36-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Acquiring lock "cinder-quobyte-9bd47eca-4a8d-499a-aaf2-3ab49e989b36" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Lock "cinder-quobyte-9bd47eca-4a8d-499a-aaf2-3ab49e989b36" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3767cdfa-bc64-4163-88fb-e2b7126177e4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:35 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 Sep 25 17:25:35 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:35 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d 1073741824" returned: 0 in 0.604s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:35 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36" returned: 0 in 0.517s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:35 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d Sep 25 17:25:35 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:35 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36 Sep 25 17:25:35 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:35 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" returned: 0 in 0.362s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:35 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-9bd47eca-4a8d-499a-aaf2-3ab49e989b36" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a057fd-7a5c-4d3e-87d2-0a57589a37d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0d4f24-387c-4488-82a2-022e8e24c099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Lock "cinder-quobyte-9bd47eca-4a8d-499a-aaf2-3ab49e989b36" released by "delete_volume" :: held 0.984s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Volume volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d (c583b4cc-a5c4-494c-858c-6bcbdaadce9d): created successfully Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0d4f24-387c-4488-82a2-022e8e24c099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (b8f358b3-e347-4fd0-8a75-62348922d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (6d8c1b55-33d9-4713-a286-cdfbe15f52f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c2a6e7-e000-4a69-81b8-75a762ecea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b6db8b32-95c1-420d-8366-75eb58d00ecc tempest-ProjectMemberTests-780059112 None] Created volume successfully. Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c2a6e7-e000-4a69-81b8-75a762ecea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1157495507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe1fdfd-86e8-4c26-a336-3430715dcf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:36Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5cc470-2d87-49a9-be36-4b7bb0970b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb5cc470-2d87-49a9-be36-4b7bb0970b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433dcee0-f84e-4c1e-b0b7-d4024567f2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433dcee0-f84e-4c1e-b0b7-d4024567f2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe1fdfd-86e8-4c26-a336-3430715dcf39', 'volume_name': 'volume-abe1fdfd-86e8-4c26-a336-3430715dcf39', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0505218c-9296-46a1-a6fe-f66fb1b7ea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0505218c-9296-46a1-a6fe-f66fb1b7ea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f925f8ca-b7f6-4830-8be1-5ae4d7652405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:36 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Volume abe1fdfd-86e8-4c26-a336-3430715dcf39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe1fdfd-86e8-4c26-a336-3430715dcf39', 'volume_size': 1} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1157495507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe1fdfd-86e8-4c26-a336-3430715dcf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:36Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Creating volume abe1fdfd-86e8-4c26-a336-3430715dcf39 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:36 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:36 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 1073741824 Sep 25 17:25:36 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Created reservations ['55b4db58-7750-45e8-b775-b1ab3265bbee', 'c11c78c5-7b9b-44fa-b65f-0b1af768dcf3', 'dde4ece0-e8c7-47da-b9fe-b5b5543fb75b', '54fce899-70f1-4817-baf1-70a8908b3f2d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:36 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:36 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:36 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:36 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Deleted volume successfully. Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fd6e14d1-59e0-4a1c-8667-ebad4a82a84c tempest-ProjectReaderTests-1783291108 None] Lock "cinder-9bd47eca-4a8d-499a-aaf2-3ab49e989b36-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:36 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 1073741824" returned: 0 in 0.600s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:36 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 Sep 25 17:25:36 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:37 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39" returned: 0 in 0.351s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f925f8ca-b7f6-4830-8be1-5ae4d7652405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe1fdfd-86e8-4c26-a336-3430715dcf39', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc25b9cd-77e7-4238-94cb-94610faf839a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:37 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Volume volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 (abe1fdfd-86e8-4c26-a336-3430715dcf39): created successfully Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc25b9cd-77e7-4238-94cb-94610faf839a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (6d8c1b55-33d9-4713-a286-cdfbe15f52f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:37 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7c4977c7-ecac-42de-bfd2-0f5855b45bf2 tempest-ProjectReaderTests-2027106632 None] Created volume successfully. Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Creating offline snapshot 1ebf0811-6f7c-4b0a-b446-39605ab40c96 of volume c583b4cc-a5c4-494c-858c-6bcbdaadce9d {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cf3a82-f154-4c5d-aa83-e708f641aa81]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:37 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d Sep 25 17:25:37 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:37 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" returned: 0 in 0.554s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:38 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 1G Sep 25 17:25:38 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Flow 'volume_create_manager' (405e9e8a-43f9-4e57-951e-90ee5221cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60df781-4079-410d-a1a2-f9d4becb3e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60df781-4079-410d-a1a2-f9d4becb3e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10319591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7a154c-4ad5-407c-8606-17912d5486ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ece37d62274666a2ca3ebd6fd4355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:38Z,use_quota=True,user_id='6c50d2173acf48cba8a8e7e9b784afbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ff121c-e73f-49ef-95c0-f05978a181e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ff121c-e73f-49ef-95c0-f05978a181e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4ab217-ff99-47c1-a14f-1216c210b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4ab217-ff99-47c1-a14f-1216c210b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7a154c-4ad5-407c-8606-17912d5486ed', 'volume_name': 'volume-af7a154c-4ad5-407c-8606-17912d5486ed', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f354df1-1b63-4601-8725-4fa4d30ff004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f354df1-1b63-4601-8725-4fa4d30ff004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56745e02-7858-4a32-945f-10cca33afc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:38 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Volume af7a154c-4ad5-407c-8606-17912d5486ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7a154c-4ad5-407c-8606-17912d5486ed', 'volume_size': 1} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:38 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 1G" returned: 0 in 0.577s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:38 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 Sep 25 17:25:38 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:38 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:38 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 is being set with open permissions: ugo+rw Sep 25 17:25:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:38 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 Sep 25 17:25:38 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:39 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96" returned: 0 in 0.296s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:39 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.info Sep 25 17:25:39 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:39 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.info" returned: 0 in 0.272s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:39 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.info is being set with open permissions: ugo+rw Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:39 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.info Sep 25 17:25:39 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:39 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.info" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.461s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Creating offline snapshot ada8ece9-a78c-4781-97a0-213c5f4d6101 of volume abe1fdfd-86e8-4c26-a336-3430715dcf39 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f70b42d9-03e8-404a-8b31-451c76430356 tempest-ProjectMemberTests-780059112 None] Create snapshot completed successfully Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba349af-e350-4fde-9bd4-f191309131fa]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:40 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 Sep 25 17:25:40 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:40 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39" returned: 0 in 0.376s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:40 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 1G Sep 25 17:25:40 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:40 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 1G" returned: 0 in 0.446s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-1ebf0811-6f7c-4b0a-b446-39605ab40c96-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:40 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 Sep 25 17:25:40 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Lock "cinder-1ebf0811-6f7c-4b0a-b446-39605ab40c96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-1ebf0811-6f7c-4b0a-b446-39605ab40c96" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-1ebf0811-6f7c-4b0a-b446-39605ab40c96" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Deleting offline snapshot 1ebf0811-6f7c-4b0a-b446-39605ab40c96 of volume c583b4cc-a5c4-494c-858c-6bcbdaadce9d {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] snapshot_file for this snap is: volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5593f976-47d8-4b22-8224-b9b9a210a24a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:41 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 Sep 25 17:25:41 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:41 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101" returned: 0 in 0.403s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:41 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 is being set with open permissions: ugo+rw Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:41 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 Sep 25 17:25:41 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:41 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96" returned: 0 in 0.506s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e0809a-32cd-4306-b664-58c8e753c637]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:41 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:41 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.info Sep 25 17:25:41 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:41 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d Sep 25 17:25:41 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:41 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.info" returned: 0 in 0.304s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:41 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.info is being set with open permissions: ugo+rw Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:41 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.info Sep 25 17:25:41 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:41 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" returned: 0 in 0.442s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:41 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 Sep 25 17:25:41 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:42 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.info" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.596s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10319591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7a154c-4ad5-407c-8606-17912d5486ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ece37d62274666a2ca3ebd6fd4355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:38Z,use_quota=True,user_id='6c50d2173acf48cba8a8e7e9b784afbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Creating volume af7a154c-4ad5-407c-8606-17912d5486ed {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:42 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:42 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed 1073741824 Sep 25 17:25:42 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c3cb3964-c62e-4afd-9178-372746ca5fbc tempest-ProjectReaderTests-2027106632 None] Create snapshot completed successfully Sep 25 17:25:42 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96" returned: 0 in 0.478s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:42 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96 Sep 25 17:25:42 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-ada8ece9-a78c-4781-97a0-213c5f4d6101-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Lock "cinder-ada8ece9-a78c-4781-97a0-213c5f4d6101-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-abe1fdfd-86e8-4c26-a336-3430715dcf39" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-abe1fdfd-86e8-4c26-a336-3430715dcf39" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-ada8ece9-a78c-4781-97a0-213c5f4d6101" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-ada8ece9-a78c-4781-97a0-213c5f4d6101" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Deleting offline snapshot ada8ece9-a78c-4781-97a0-213c5f4d6101 of volume abe1fdfd-86e8-4c26-a336-3430715dcf39 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] snapshot_file for this snap is: volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[94335422-653d-45e0-9160-b8e1f55588f1]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:42 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed 1073741824" returned: 0 in 0.549s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:42 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d.1ebf0811-6f7c-4b0a-b446-39605ab40c96" returned: 0 in 0.311s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:42 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 Sep 25 17:25:42 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-1ebf0811-6f7c-4b0a-b446-39605ab40c96" released by "_delete_snapshot" :: held 1.906s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" released by "delete_snapshot" :: held 1.938s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:42 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed Sep 25 17:25:42 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Created reservations ['99747ca7-320f-41fd-8733-9e5bb4519459', '8ed4c5c6-d49d-4080-a9ad-8109fb54fd2d', 'bb82a492-eb20-46eb-b886-ee38a4f39928', 'e8b5be4a-b1de-490c-8b9f-f1c665567c55'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:42 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Delete snapshot completed successfully. Sep 25 17:25:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-9e514aa3-44b1-4382-b121-6913f4a9a127 tempest-ProjectMemberTests-780059112 None] Lock "cinder-1ebf0811-6f7c-4b0a-b446-39605ab40c96-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-c583b4cc-a5c4-494c-858c-6bcbdaadce9d-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Lock "cinder-c583b4cc-a5c4-494c-858c-6bcbdaadce9d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:43 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101" returned: 0 in 0.478s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abe1fdfd-86e8-4c26-a336-3430715dcf39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:43 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b45aac-2cfe-4622-9ed2-a6176454094a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56745e02-7858-4a32-945f-10cca33afc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7a154c-4ad5-407c-8606-17912d5486ed', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e3d718-880f-402e-bf78-326af162e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" acquired by "delete_volume" :: waited 0.052s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Volume volume-af7a154c-4ad5-407c-8606-17912d5486ed (af7a154c-4ad5-407c-8606-17912d5486ed): created successfully Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e3d718-880f-402e-bf78-326af162e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Flow 'volume_create_manager' (405e9e8a-43f9-4e57-951e-90ee5221cab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[364db1d3-f0b9-498d-8e2a-5956b62dc3ce]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-751ddcb2-6ba5-4fe7-aa42-03456ce640ff tempest-ProjectReaderTests-1783291108 None] Created volume successfully. Sep 25 17:25:43 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 Sep 25 17:25:43 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:43 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d Sep 25 17:25:43 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Acquiring lock "cinder-af7a154c-4ad5-407c-8606-17912d5486ed-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Lock "cinder-af7a154c-4ad5-407c-8606-17912d5486ed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Acquiring lock "cinder-quobyte-af7a154c-4ad5-407c-8606-17912d5486ed" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Lock "cinder-quobyte-af7a154c-4ad5-407c-8606-17912d5486ed" acquired by "delete_volume" :: waited 0.039s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14769ef-6dae-4d83-a7b7-11d4f2f9835a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:43 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39" returned: 0 in 0.565s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:43 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 Sep 25 17:25:43 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:43 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:43 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" returned: 0 in 0.560s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:43 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:43 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d Sep 25 17:25:43 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:44 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed" returned: 0 in 0.446s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:44 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed Sep 25 17:25:44 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:44 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:44 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101" returned: 0 in 0.489s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-c583b4cc-a5c4-494c-858c-6bcbdaadce9d" released by "delete_volume" :: held 1.031s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:44 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101 Sep 25 17:25:44 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Created reservations ['34768e95-4501-49a3-af8a-ab8eff79d041', 'cfb61e7d-d87a-41ad-bcee-f26565c4698c', '0ce7e91f-da4d-418c-94d0-fc0de27e5fd1', '77b7412a-ef77-4ebf-92ed-9626a3ac51b4'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:44 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:44 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:44 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-af7a154c-4ad5-407c-8606-17912d5486ed" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Lock "cinder-quobyte-af7a154c-4ad5-407c-8606-17912d5486ed" released by "delete_volume" :: held 0.885s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:44 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39.ada8ece9-a78c-4781-97a0-213c5f4d6101" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-ada8ece9-a78c-4781-97a0-213c5f4d6101" released by "_delete_snapshot" :: held 2.044s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Created reservations ['3c5d3c8a-ba40-421a-b82f-43fa65a8f7ea', '9d338f10-3d94-433a-bcfd-6caee5291e58', '9cd2a286-3c67-4d2f-ad2b-06b5e6103167', '1bcf368b-5489-4a31-be16-c4d9020c70cd'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-abe1fdfd-86e8-4c26-a336-3430715dcf39" released by "delete_snapshot" :: held 2.078s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:44 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.315s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Deleted volume successfully. Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-fa8924d7-c6f4-4663-8284-59017dffa5be tempest-ProjectMemberTests-780059112 None] Lock "cinder-c583b4cc-a5c4-494c-858c-6bcbdaadce9d-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:44 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Created reservations ['a8e32ddd-0e65-47c5-a76f-4572558aaa00', 'f9f0883c-c217-42af-b9ee-b1e0775ede1a', 'a3d4da64-9b00-4e95-af07-39887081432b', '2a78e355-f3f2-40b8-a061-14d598099d67'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:44 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:44 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Delete snapshot completed successfully. Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b0481961-1031-40f5-a199-defe009916ad tempest-ProjectReaderTests-2027106632 None] Lock "cinder-ada8ece9-a78c-4781-97a0-213c5f4d6101-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:45 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Deleted volume successfully. Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-01e132a0-ba00-4735-88bb-b28ad75e361a tempest-ProjectReaderTests-1783291108 None] Lock "cinder-af7a154c-4ad5-407c-8606-17912d5486ed-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Flow 'volume_create_manager' (1186a41a-3c1f-44fa-bddc-2a9ef5cba565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae93a8ad-a0a4-4fba-b0c3-fe1bb3ed065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae93a8ad-a0a4-4fba-b0c3-fe1bb3ed065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673775727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0736fd-6fa5-4fcf-b556-d6009ecc83f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ece37d62274666a2ca3ebd6fd4355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:45Z,use_quota=True,user_id='6c50d2173acf48cba8a8e7e9b784afbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d30d1fa-caab-4b45-97cc-374f3226bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d30d1fa-caab-4b45-97cc-374f3226bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c689d9-55c2-422b-a6e3-f6e59ba07a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c689d9-55c2-422b-a6e3-f6e59ba07a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0736fd-6fa5-4fcf-b556-d6009ecc83f9', 'volume_name': 'volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02b65e0-0286-449e-9a45-8a1da89e55b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02b65e0-0286-449e-9a45-8a1da89e55b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ba21c1-7884-41f6-a62e-403833609f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Volume db0736fd-6fa5-4fcf-b556-d6009ecc83f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9', 'volume_size': 1} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673775727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0736fd-6fa5-4fcf-b556-d6009ecc83f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ece37d62274666a2ca3ebd6fd4355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:45Z,use_quota=True,user_id='6c50d2173acf48cba8a8e7e9b784afbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Creating volume db0736fd-6fa5-4fcf-b556-d6009ecc83f9 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:45 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:45 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 1073741824 Sep 25 17:25:45 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-abe1fdfd-86e8-4c26-a336-3430715dcf39-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-abe1fdfd-86e8-4c26-a336-3430715dcf39-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:45 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-abe1fdfd-86e8-4c26-a336-3430715dcf39" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-abe1fdfd-86e8-4c26-a336-3430715dcf39" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[01141944-15b7-46c7-a4f3-cb911202f9d9]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (06638add-66c3-4d23-b9ad-6d89f770eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4aca2-be96-479c-8f2b-e8904a458494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4aca2-be96-479c-8f2b-e8904a458494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614489319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d806bb-c1e7-4965-bdf2-a205161f77ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:46Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663a0a03-8caa-4cd5-a60c-78ecab1d21ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663a0a03-8caa-4cd5-a60c-78ecab1d21ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3775f63f-0ef9-4553-801b-a9e5520be4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3775f63f-0ef9-4553-801b-a9e5520be4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d806bb-c1e7-4965-bdf2-a205161f77ce', 'volume_name': 'volume-87d806bb-c1e7-4965-bdf2-a205161f77ce', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e38af9-3ff7-4512-894e-7211e818a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e38af9-3ff7-4512-894e-7211e818a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c985852-d131-4a8c-8901-07963ca0ec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Volume 87d806bb-c1e7-4965-bdf2-a205161f77ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d806bb-c1e7-4965-bdf2-a205161f77ce', 'volume_size': 1} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:46 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:46 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 Sep 25 17:25:46 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 1073741824" returned: 0 in 0.617s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:46 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 Sep 25 17:25:46 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:46 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39" returned: 0 in 0.441s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:46 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39 Sep 25 17:25:46 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:46 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9" returned: 0 in 0.337s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.421s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614489319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d806bb-c1e7-4965-bdf2-a205161f77ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:46Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Creating volume 87d806bb-c1e7-4965-bdf2-a205161f77ce {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:46 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ba21c1-7884-41f6-a62e-403833609f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:46 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce 1073741824 Sep 25 17:25:46 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f14c4a9-9b5b-409c-9c0d-6ac1e75824c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Volume volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 (db0736fd-6fa5-4fcf-b556-d6009ecc83f9): created successfully Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f14c4a9-9b5b-409c-9c0d-6ac1e75824c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Flow 'volume_create_manager' (1186a41a-3c1f-44fa-bddc-2a9ef5cba565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:46 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1aaa898a-f0b9-4759-97da-0934e51247c4 tempest-ProjectReaderTests-1783291108 None] Created volume successfully. Sep 25 17:25:46 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-abe1fdfd-86e8-4c26-a336-3430715dcf39" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-abe1fdfd-86e8-4c26-a336-3430715dcf39" released by "delete_volume" :: held 0.830s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Created reservations ['cf0409a2-f47b-4281-8e21-418e3b88fc2a', 'e43d55ce-8b83-4843-bd27-8894aa71ea02', '129efd83-2e7c-4f8b-b042-f76b85ea24eb', 'f051cc45-dee5-4694-8e92-3f9d6d35dde1'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:46 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:47 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:47 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:47 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce 1073741824" returned: 0 in 0.620s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:47 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce Sep 25 17:25:47 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:47 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.345s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Deleted volume successfully. Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-48221ab3-fd4c-47fb-89f5-aa5362c832a4 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-abe1fdfd-86e8-4c26-a336-3430715dcf39-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:47 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce" returned: 0 in 0.367s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c985852-d131-4a8c-8901-07963ca0ec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d806bb-c1e7-4965-bdf2-a205161f77ce', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c99fef6-72dd-40d0-add2-98156c6e725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Acquiring lock "cinder-db0736fd-6fa5-4fcf-b556-d6009ecc83f9-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Volume volume-87d806bb-c1e7-4965-bdf2-a205161f77ce (87d806bb-c1e7-4965-bdf2-a205161f77ce): created successfully Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c99fef6-72dd-40d0-add2-98156c6e725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (06638add-66c3-4d23-b9ad-6d89f770eb90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (a2c7e0aa-3bf5-41fb-83f8-e2d10ff8ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad2c6bb-8bda-4e06-a1c3-669da235b5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Lock "cinder-db0736fd-6fa5-4fcf-b556-d6009ecc83f9-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-1802ce8b-68a5-4356-b643-ff1bd34f69f3 tempest-ProjectMemberTests-780059112 None] Created volume successfully. Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad2c6bb-8bda-4e06-a1c3-669da235b5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620955910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bc7675-6c7f-4e86-9629-9f28215c8d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:48Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac82feb1-8efc-42b0-9b20-9579ca4180e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac82feb1-8efc-42b0-9b20-9579ca4180e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faa275a-a3f0-4141-9e87-8b02ce3e63d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faa275a-a3f0-4141-9e87-8b02ce3e63d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09bc7675-6c7f-4e86-9629-9f28215c8d4a', 'volume_name': 'volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ba53a3-332d-4c8b-8ad1-1f3bf45a3074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ba53a3-332d-4c8b-8ad1-1f3bf45a3074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c633a00-743a-42d4-87a1-778b18ef1e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:47 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Volume 09bc7675-6c7f-4e86-9629-9f28215c8d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a', 'volume_size': 1} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620955910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bc7675-6c7f-4e86-9629-9f28215c8d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa02051256274bfdb22736c5bf42e9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:48Z,use_quota=True,user_id='fe1ca07f8c2043b0861f77ae224d4994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Creating volume 09bc7675-6c7f-4e86-9629-9f28215c8d4a {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:47 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:47 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a 1073741824 Sep 25 17:25:47 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Acquiring lock "cinder-quobyte-db0736fd-6fa5-4fcf-b556-d6009ecc83f9" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Lock "cinder-quobyte-db0736fd-6fa5-4fcf-b556-d6009ecc83f9" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[901cfa72-4354-425a-8166-855fe3260d56]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:48 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 Sep 25 17:25:48 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:48 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9" returned: 0 in 0.507s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:48 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a 1073741824" returned: 0 in 0.667s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:48 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9 Sep 25 17:25:48 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:48 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a Sep 25 17:25:48 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:48 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:48 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.612s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-db0736fd-6fa5-4fcf-b556-d6009ecc83f9" returned: 0 in 0.408s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Creating offline snapshot 687d27ca-74f6-4380-a1c0-facc8314c473 of volume 87d806bb-c1e7-4965-bdf2-a205161f77ce {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:48 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c633a00-743a-42d4-87a1-778b18ef1e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39da49b5-46b9-4efe-815b-8ece44c1c7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81aac37-db4f-4012-9aea-1a6fa53aefb4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Lock "cinder-quobyte-db0736fd-6fa5-4fcf-b556-d6009ecc83f9" released by "delete_volume" :: held 1.010s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:49 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Volume volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a (09bc7675-6c7f-4e86-9629-9f28215c8d4a): created successfully Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39da49b5-46b9-4efe-815b-8ece44c1c7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Flow 'volume_create_manager' (a2c7e0aa-3bf5-41fb-83f8-e2d10ff8ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6b675c6d-f4b0-4c79-aed3-be409da5f3d3 tempest-ProjectReaderTests-2027106632 None] Created volume successfully. Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Created reservations ['c17cc508-2523-4950-896d-18b5e7152278', '6850df85-ec72-477d-9fc6-7ffbfc1e0f85', 'da17e100-abcb-49d4-8a8e-65401e7564f6', '3ed0e04b-5eaf-4800-9c4d-31edb4d12e8b'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:49 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce Sep 25 17:25:49 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:49 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:49 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:49 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce" returned: 0 in 0.477s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:49 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 1G Sep 25 17:25:49 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:49 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.322s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:49 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Deleted volume successfully. Sep 25 17:25:49 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7f487eb7-3706-4984-bfd9-de43be225245 tempest-ProjectReaderTests-1783291108 None] Lock "cinder-db0736fd-6fa5-4fcf-b556-d6009ecc83f9-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:50 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 1G" returned: 0 in 0.573s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87d806bb-c1e7-4965-bdf2-a205161f77ce -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:50 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87d806bb-c1e7-4965-bdf2-a205161f77ce -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 Sep 25 17:25:50 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:50 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87d806bb-c1e7-4965-bdf2-a205161f77ce -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473" returned: 0 in 0.351s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:50 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 is being set with open permissions: ugo+rw Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:50 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 Sep 25 17:25:50 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Flow 'volume_create_manager' (d9d9c0c3-0f61-4ac1-b96c-41765dec3941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c5282c-7fe8-4a51-86a4-afa08048def7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c5282c-7fe8-4a51-86a4-afa08048def7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701449344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa75262-d9bc-408e-ade6-fdc8c581343e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ece37d62274666a2ca3ebd6fd4355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:51Z,use_quota=True,user_id='6c50d2173acf48cba8a8e7e9b784afbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf5804d-1e42-4211-9e7d-7d31f10d5ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf5804d-1e42-4211-9e7d-7d31f10d5ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326f1b25-18cc-4d46-8364-f522ae39166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326f1b25-18cc-4d46-8364-f522ae39166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa75262-d9bc-408e-ade6-fdc8c581343e', 'volume_name': 'volume-daa75262-d9bc-408e-ade6-fdc8c581343e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:50 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63bbd97-3817-4ad3-91df-5d17531ee21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63bbd97-3817-4ad3-91df-5d17531ee21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b7c7c1-3c3c-4dce-adbb-eaa4300e1460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:50 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Volume daa75262-d9bc-408e-ade6-fdc8c581343e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa75262-d9bc-408e-ade6-fdc8c581343e', 'volume_size': 1} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473" returned: 0 in 0.375s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:50 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.info Sep 25 17:25:50 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:51 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.info" returned: 0 in 0.266s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:51 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.info is being set with open permissions: ugo+rw Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:51 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.info Sep 25 17:25:51 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:51 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.info" returned: 0 in 0.275s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.271s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Creating offline snapshot 244958e4-6b52-43b1-8ec3-1526b5cb41a9 of volume 09bc7675-6c7f-4e86-9629-9f28215c8d4a {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:51 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ec8a57f2-583b-47a2-8c33-219f54a0c942 tempest-ProjectMemberTests-780059112 None] Create snapshot completed successfully Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c8014f-e07c-4de7-b4c4-950b25917812]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:51 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a Sep 25 17:25:51 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:51 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a" returned: 0 in 0.426s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:51 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 1G Sep 25 17:25:51 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:52 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 1G" returned: 0 in 0.440s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:52 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 Sep 25 17:25:52 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-687d27ca-74f6-4380-a1c0-facc8314c473-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-687d27ca-74f6-4380-a1c0-facc8314c473-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-87d806bb-c1e7-4965-bdf2-a205161f77ce" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-87d806bb-c1e7-4965-bdf2-a205161f77ce" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-687d27ca-74f6-4380-a1c0-facc8314c473" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-687d27ca-74f6-4380-a1c0-facc8314c473" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Deleting offline snapshot 687d27ca-74f6-4380-a1c0-facc8314c473 of volume 87d806bb-c1e7-4965-bdf2-a205161f77ce {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] snapshot_file for this snap is: volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3b18d5-8f7d-45d2-87d0-546d5bd8b4b9]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:52 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9" returned: 0 in 0.330s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:52 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 is being set with open permissions: ugo+rw Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:52 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 Sep 25 17:25:52 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:52 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 Sep 25 17:25:52 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:52 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9" returned: 0 in 0.295s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:53 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.info Sep 25 17:25:53 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:53 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473" returned: 0 in 0.421s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87d806bb-c1e7-4965-bdf2-a205161f77ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[89936018-f6f8-450b-887f-8e4ee256f3a7]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:53 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce Sep 25 17:25:53 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:53 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.info" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:53 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.info is being set with open permissions: ugo+rw Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:53 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.info Sep 25 17:25:53 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:53 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:53 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 Sep 25 17:25:53 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:53 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.info" returned: 0 in 0.294s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.805s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701449344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa75262-d9bc-408e-ade6-fdc8c581343e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ece37d62274666a2ca3ebd6fd4355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:51Z,use_quota=True,user_id='6c50d2173acf48cba8a8e7e9b784afbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Creating volume daa75262-d9bc-408e-ade6-fdc8c581343e {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:53 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:53 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e 1073741824 Sep 25 17:25:53 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f403751b-93bc-4339-b580-1f5cf8cd7c9f tempest-ProjectReaderTests-2027106632 None] Create snapshot completed successfully Sep 25 17:25:53 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473" returned: 0 in 0.390s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:53 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473 Sep 25 17:25:53 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:54 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e 1073741824" returned: 0 in 0.487s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:54 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:54 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce.687d27ca-74f6-4380-a1c0-facc8314c473" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:54 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-687d27ca-74f6-4380-a1c0-facc8314c473" released by "_delete_snapshot" :: held 1.646s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-87d806bb-c1e7-4965-bdf2-a205161f77ce" released by "delete_snapshot" :: held 1.675s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Created reservations ['6f3bb0d7-f01d-44b9-a4b3-e09bd593ae72', 'cf8b461b-d32d-4aff-9aae-c1785262fb94', 'af5b2563-67d1-4620-ac78-15999aad0c66', '9525258b-c7bb-4cdd-b911-c65da73d5bc3'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-244958e4-6b52-43b1-8ec3-1526b5cb41a9-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Lock "cinder-244958e4-6b52-43b1-8ec3-1526b5cb41a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-09bc7675-6c7f-4e86-9629-9f28215c8d4a" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Delete snapshot completed successfully. Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4a664623-71bf-40ff-9f68-a773e1c3bfa4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-687d27ca-74f6-4380-a1c0-facc8314c473-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-09bc7675-6c7f-4e86-9629-9f28215c8d4a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-244958e4-6b52-43b1-8ec3-1526b5cb41a9" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-244958e4-6b52-43b1-8ec3-1526b5cb41a9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Deleting offline snapshot 244958e4-6b52-43b1-8ec3-1526b5cb41a9 of volume 09bc7675-6c7f-4e86-9629-9f28215c8d4a {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:25:54 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] snapshot_file for this snap is: volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d6b776-35b4-4b66-bd2f-60c4537a1467]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b7c7c1-3c3c-4dce-adbb-eaa4300e1460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa75262-d9bc-408e-ade6-fdc8c581343e', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce1a56-f845-4c31-845c-ebcc3ac9856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:54 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Volume volume-daa75262-d9bc-408e-ade6-fdc8c581343e (daa75262-d9bc-408e-ade6-fdc8c581343e): created successfully Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ce1a56-f845-4c31-845c-ebcc3ac9856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Flow 'volume_create_manager' (d9d9c0c3-0f61-4ac1-b96c-41765dec3941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:54 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7790351c-25b1-4a98-9ba4-4e377ef81e10 tempest-ProjectReaderTests-1783291108 None] Created volume successfully. Sep 25 17:25:54 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 Sep 25 17:25:54 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-87d806bb-c1e7-4965-bdf2-a205161f77ce-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Lock "cinder-87d806bb-c1e7-4965-bdf2-a205161f77ce-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-87d806bb-c1e7-4965-bdf2-a205161f77ce" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-87d806bb-c1e7-4965-bdf2-a205161f77ce" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:54 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9" returned: 0 in 0.436s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73c8afe-f78c-4876-b650-1db86856adb3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Acquiring lock "cinder-daa75262-d9bc-408e-ade6-fdc8c581343e-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1d5d03-4947-460c-aa07-1e0fa541d059]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Lock "cinder-daa75262-d9bc-408e-ade6-fdc8c581343e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Acquiring lock "cinder-quobyte-daa75262-d9bc-408e-ade6-fdc8c581343e" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Lock "cinder-quobyte-daa75262-d9bc-408e-ade6-fdc8c581343e" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:55 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce Sep 25 17:25:55 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e85721a-d91a-4d5a-ab6b-2cbbae155159]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:55 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a Sep 25 17:25:55 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:55 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e Sep 25 17:25:55 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:55 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:55 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce Sep 25 17:25:55 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:55 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a" returned: 0 in 0.496s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:55 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 Sep 25 17:25:55 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:55 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e" returned: 0 in 0.445s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:55 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e Sep 25 17:25:55 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:55 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-87d806bb-c1e7-4965-bdf2-a205161f77ce" returned: 0 in 0.297s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-87d806bb-c1e7-4965-bdf2-a205161f77ce" released by "delete_volume" :: held 0.826s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Created reservations ['01d92e86-68e9-4986-9ddc-74948e493b0e', '2a2c002b-7d51-4eae-943b-98afcb05d6cb', '965c8bd1-1b82-4203-99e3-60a450547bda', 'c4b10eeb-400b-4ae5-a31f-54532242503d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:55 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-daa75262-d9bc-408e-ade6-fdc8c581343e" returned: 0 in 0.273s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Lock "cinder-quobyte-daa75262-d9bc-408e-ade6-fdc8c581343e" released by "delete_volume" :: held 0.777s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:55 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:55 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9" returned: 0 in 0.421s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:55 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:55 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9 Sep 25 17:25:55 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Created reservations ['91d20bb6-c02d-461b-9912-8f549dfb560d', 'ac1800ee-5142-4d8a-9a29-d629ccac2785', '355cc2ea-88e1-4b86-ae27-583c7a0ebebe', '459524f9-a4cc-4f55-9433-d9aee3c85181'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:56 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:56 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:56 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.354s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:56 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Deleted volume successfully. Sep 25 17:25:56 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:56 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-18557bef-8ef0-4f7d-a9a2-3e537ac5b176 tempest-ProjectMemberTests-780059112 None] Lock "cinder-87d806bb-c1e7-4965-bdf2-a205161f77ce-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a.244958e4-6b52-43b1-8ec3-1526b5cb41a9" returned: 0 in 0.386s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-244958e4-6b52-43b1-8ec3-1526b5cb41a9" released by "_delete_snapshot" :: held 1.889s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-09bc7675-6c7f-4e86-9629-9f28215c8d4a" released by "delete_snapshot" :: held 1.920s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Created reservations ['e0c8a67f-8c78-437d-8893-8bca635af8cb', 'e9f16640-8db9-4a0a-a537-450bb0827ae0', 'd1635f33-5ddb-4759-a49c-5c1173923f25', 'b516fb06-f753-4675-b9b8-698bc57eeeb9'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Delete snapshot completed successfully. Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-019e1cab-e9a4-44da-9782-798b9260b17a tempest-ProjectReaderTests-2027106632 None] Lock "cinder-244958e4-6b52-43b1-8ec3-1526b5cb41a9-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:56 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.485s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:25:56 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.437s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Deleted volume successfully. Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-53bd64a6-12cb-4727-96c9-f40bc444240c tempest-ProjectReaderTests-1783291108 None] Lock "cinder-daa75262-d9bc-408e-ade6-fdc8c581343e-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (830f38ce-2d69-4419-bb5b-8bf719bd6ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb0d7b5-f3d5-49fa-be55-cc9f12af7044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb0d7b5-f3d5-49fa-be55-cc9f12af7044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997141590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c195471-012e-4905-b4a7-8feb24040c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:57Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e5526d-24c0-43c2-9c0c-f77a720a8e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e5526d-24c0-43c2-9c0c-f77a720a8e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f10f820-8374-4cb3-ba39-4ce4267819f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f10f820-8374-4cb3-ba39-4ce4267819f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c195471-012e-4905-b4a7-8feb24040c12', 'volume_name': 'volume-4c195471-012e-4905-b4a7-8feb24040c12', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92558678-54d7-4ee3-84ff-8b5b3cc4dc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92558678-54d7-4ee3-84ff-8b5b3cc4dc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429d8587-955e-4b98-be7d-0eb84124036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Volume 4c195471-012e-4905-b4a7-8feb24040c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c195471-012e-4905-b4a7-8feb24040c12', 'volume_size': 1} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997141590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c195471-012e-4905-b4a7-8feb24040c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:25:57Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Creating volume 4c195471-012e-4905-b4a7-8feb24040c12 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:25:56 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:25:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:56 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 1073741824 Sep 25 17:25:56 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:57 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 1073741824" returned: 0 in 0.484s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:57 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 Sep 25 17:25:57 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-09bc7675-6c7f-4e86-9629-9f28215c8d4a-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-09bc7675-6c7f-4e86-9629-9f28215c8d4a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:57 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12" returned: 0 in 0.374s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "cinder-quobyte-09bc7675-6c7f-4e86-9629-9f28215c8d4a" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429d8587-955e-4b98-be7d-0eb84124036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c195471-012e-4905-b4a7-8feb24040c12', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adde4f98-1edc-4039-91da-4e5a69ea87e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-09bc7675-6c7f-4e86-9629-9f28215c8d4a" acquired by "delete_volume" :: waited 0.028s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:25:57 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Volume volume-4c195471-012e-4905-b4a7-8feb24040c12 (4c195471-012e-4905-b4a7-8feb24040c12): created successfully Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adde4f98-1edc-4039-91da-4e5a69ea87e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (830f38ce-2d69-4419-bb5b-8bf719bd6ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4660e41-0b28-4f08-bc99-b71afc282eb2]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:57 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-dea220e1-3e7b-48fe-aaf8-37528e8b00fa tempest-ProjectMemberTests-780059112 None] Created volume successfully. Sep 25 17:25:58 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a Sep 25 17:25:58 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:58 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:58 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a Sep 25 17:25:58 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:58 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-09bc7675-6c7f-4e86-9629-9f28215c8d4a" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-quobyte-09bc7675-6c7f-4e86-9629-9f28215c8d4a" released by "delete_volume" :: held 0.759s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Created reservations ['373d3045-d444-4365-bffb-ebf1f1753507', '4209db45-2718-4c5b-8038-36e13812840f', '172993d8-e40e-451c-acab-4dbdfb8a6936', '6ca989ee-ee94-4b99-a2a6-34f30630065d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:25:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:58 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:25:58 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:59 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.293s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:25:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Deleted volume successfully. Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b46777d3-a3f6-428c-abe8-15c186c99259 tempest-ProjectReaderTests-2027106632 None] Lock "cinder-09bc7675-6c7f-4e86-9629-9f28215c8d4a-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Creating offline snapshot d9b188b0-f061-4352-94e5-edfc2cc2bf7f of volume 4c195471-012e-4905-b4a7-8feb24040c12 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[277bebd3-930b-4b63-8cc0-536c17982a55]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:59 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 Sep 25 17:25:59 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:25:59 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12" returned: 0 in 0.383s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:25:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:25:59 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f 1G Sep 25 17:25:59 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:00 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f 1G" returned: 0 in 0.453s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c195471-012e-4905-b4a7-8feb24040c12 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:00 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c195471-012e-4905-b4a7-8feb24040c12 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f Sep 25 17:26:00 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:00 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c195471-012e-4905-b4a7-8feb24040c12 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f" returned: 0 in 0.339s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:00 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f is being set with open permissions: ugo+rw Sep 25 17:26:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:00 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f Sep 25 17:26:00 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:00 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f" returned: 0 in 0.284s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:00 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.info Sep 25 17:26:00 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:00 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.info" returned: 0 in 0.288s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:00 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.info is being set with open permissions: ugo+rw Sep 25 17:26:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:00 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.info Sep 25 17:26:00 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:01 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.info" returned: 0 in 0.259s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:01 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6e29dd7e-4e16-4d8c-86a1-a57d99d69f12 tempest-ProjectMemberTests-780059112 None] Create snapshot completed successfully Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-d9b188b0-f061-4352-94e5-edfc2cc2bf7f-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Lock "cinder-d9b188b0-f061-4352-94e5-edfc2cc2bf7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-4c195471-012e-4905-b4a7-8feb24040c12" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-4c195471-012e-4905-b4a7-8feb24040c12" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-d9b188b0-f061-4352-94e5-edfc2cc2bf7f" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-d9b188b0-f061-4352-94e5-edfc2cc2bf7f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Deleting offline snapshot d9b188b0-f061-4352-94e5-edfc2cc2bf7f of volume 4c195471-012e-4905-b4a7-8feb24040c12 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] snapshot_file for this snap is: volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc1c563-141d-4370-93c0-3fea463cd2ee]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:02 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f Sep 25 17:26:02 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:02 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c195471-012e-4905-b4a7-8feb24040c12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e95554-48c5-4217-8e70-1f7ed6fb0c0d]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:02 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 Sep 25 17:26:02 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:03 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12" returned: 0 in 0.365s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:03 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f Sep 25 17:26:03 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:03 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f" returned: 0 in 0.325s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:03 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f Sep 25 17:26:03 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:03 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12.d9b188b0-f061-4352-94e5-edfc2cc2bf7f" returned: 0 in 0.241s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-d9b188b0-f061-4352-94e5-edfc2cc2bf7f" released by "_delete_snapshot" :: held 1.454s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-4c195471-012e-4905-b4a7-8feb24040c12" released by "delete_snapshot" :: held 1.478s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Created reservations ['a61bce39-40c7-41a3-9b39-5504ee069e29', '7a3ee39d-6bae-4951-8a63-8d107daa0160', 'd17e42ae-ae19-4a25-8985-e73d444b2631', '251fc651-ff8d-4644-9f91-dcdcb1251205'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:03 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Delete snapshot completed successfully. Sep 25 17:26:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-166000a5-bc22-4804-b6d5-ee349f63ff18 tempest-ProjectMemberTests-780059112 None] Lock "cinder-d9b188b0-f061-4352-94e5-edfc2cc2bf7f-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-4c195471-012e-4905-b4a7-8feb24040c12-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Lock "cinder-4c195471-012e-4905-b4a7-8feb24040c12-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-4c195471-012e-4905-b4a7-8feb24040c12" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-4c195471-012e-4905-b4a7-8feb24040c12" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:04 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cd8daf-33ae-4694-a0ae-dde8588ee438]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:04 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 Sep 25 17:26:04 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:05 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:05 devstack sudo[109238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12 Sep 25 17:26:05 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:05 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4c195471-012e-4905-b4a7-8feb24040c12" returned: 0 in 0.255s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-4c195471-012e-4905-b4a7-8feb24040c12" released by "delete_volume" :: held 0.709s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Created reservations ['e3eeeed1-bc79-40e3-bf0a-00268556210f', '96036c2b-a440-433f-a62d-940217ba937a', '703a8d3c-c068-4e4a-9241-c483ee728453', '6d79977c-1ac6-43ac-aaee-7277d30784de'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:05 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:26:05 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:05 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:05 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Deleted volume successfully. Sep 25 17:26:05 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-64053559-1b92-422c-a445-ee6b6c088341 tempest-ProjectMemberTests-780059112 None] Lock "cinder-4c195471-012e-4905-b4a7-8feb24040c12-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (2d632296-ef94-4c21-b438-7c0cbf69c51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e929e9c-7445-4e00-b93e-a50ff4582e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e929e9c-7445-4e00-b93e-a50ff4582e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079325971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dfbde7-b87d-4804-af37-f502f0dfc451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:06Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccfd261-c203-4b74-9c8e-9ec9072c163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccfd261-c203-4b74-9c8e-9ec9072c163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ba306a-93b8-4d12-a685-44ea6df9b7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ba306a-93b8-4d12-a685-44ea6df9b7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7dfbde7-b87d-4804-af37-f502f0dfc451', 'volume_name': 'volume-a7dfbde7-b87d-4804-af37-f502f0dfc451', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58c98c5-ee49-43a3-81a9-d170c655be50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58c98c5-ee49-43a3-81a9-d170c655be50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8c05ad-e7b9-482b-b5bd-df349d91870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:06 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Volume a7dfbde7-b87d-4804-af37-f502f0dfc451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7dfbde7-b87d-4804-af37-f502f0dfc451', 'volume_size': 1} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079325971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dfbde7-b87d-4804-af37-f502f0dfc451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:06Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Creating volume a7dfbde7-b87d-4804-af37-f502f0dfc451 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:06 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:06 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 1073741824 Sep 25 17:26:06 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:06 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 1073741824" returned: 0 in 0.478s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:06 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:06 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 Sep 25 17:26:06 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:07 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451" returned: 0 in 0.246s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:07 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:07 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8c05ad-e7b9-482b-b5bd-df349d91870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7dfbde7-b87d-4804-af37-f502f0dfc451', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ddf075-3446-488f-b4d9-34aa9c0bfb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:07 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Volume volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 (a7dfbde7-b87d-4804-af37-f502f0dfc451): created successfully Sep 25 17:26:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ddf075-3446-488f-b4d9-34aa9c0bfb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:07 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (2d632296-ef94-4c21-b438-7c0cbf69c51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:07 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8c3f2348-2c8d-4249-86e4-61fc93cf696a tempest-ProjectMemberTests-780059112 None] Created volume successfully. Sep 25 17:26:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Creating offline snapshot 4aae42de-cc2d-43e3-ac45-062396f3b020 of volume a7dfbde7-b87d-4804-af37-f502f0dfc451 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:26:08 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e0c5f-c44d-4bc5-8aee-2428b7946ef3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:08 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 Sep 25 17:26:08 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:08 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451" returned: 0 in 0.389s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:08 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 1G Sep 25 17:26:08 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:09 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 1G" returned: 0 in 0.499s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:09 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 Sep 25 17:26:09 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:09 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020" returned: 0 in 0.366s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:09 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 is being set with open permissions: ugo+rw Sep 25 17:26:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:09 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 Sep 25 17:26:09 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:10 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020" returned: 0 in 0.287s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:10 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.info Sep 25 17:26:10 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:10 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.info" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:10 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.info is being set with open permissions: ugo+rw Sep 25 17:26:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:10 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.info Sep 25 17:26:10 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:10 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.info" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3dfc66e6-02dd-46fc-b0fa-4a7626f419d8 tempest-ProjectMemberTests-780059112 None] Create snapshot completed successfully Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-4aae42de-cc2d-43e3-ac45-062396f3b020-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Lock "cinder-4aae42de-cc2d-43e3-ac45-062396f3b020-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-a7dfbde7-b87d-4804-af37-f502f0dfc451" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-a7dfbde7-b87d-4804-af37-f502f0dfc451" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-4aae42de-cc2d-43e3-ac45-062396f3b020" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-4aae42de-cc2d-43e3-ac45-062396f3b020" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Deleting offline snapshot 4aae42de-cc2d-43e3-ac45-062396f3b020 of volume a7dfbde7-b87d-4804-af37-f502f0dfc451 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] snapshot_file for this snap is: volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[431e89f3-ce96-4b8b-b019-e7fc81e1f044]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:11 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 Sep 25 17:26:11 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:12 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020" returned: 0 in 0.420s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7dfbde7-b87d-4804-af37-f502f0dfc451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:12 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2645ec1-00f3-42a8-aa73-4a491938f3cf]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:12 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 Sep 25 17:26:12 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:12 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:12 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 Sep 25 17:26:12 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:12 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020" returned: 0 in 0.371s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:12 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020 Sep 25 17:26:12 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:13 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451.4aae42de-cc2d-43e3-ac45-062396f3b020" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-4aae42de-cc2d-43e3-ac45-062396f3b020" released by "_delete_snapshot" :: held 1.578s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-a7dfbde7-b87d-4804-af37-f502f0dfc451" released by "delete_snapshot" :: held 1.610s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Created reservations ['f38c0099-6207-4a60-820b-c76ead7df321', '631c06e0-4123-4d24-880b-d12cf08ab15e', '49580b08-0884-4b84-b694-e52ba3e3008e', '87b66016-e51d-437e-9dc4-8d83e5304de4'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:13 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Delete snapshot completed successfully. Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-b729cf40-1405-4f07-87a4-b840f6020f89 tempest-ProjectMemberTests-780059112 None] Lock "cinder-4aae42de-cc2d-43e3-ac45-062396f3b020-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-a7dfbde7-b87d-4804-af37-f502f0dfc451-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Lock "cinder-a7dfbde7-b87d-4804-af37-f502f0dfc451-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-a7dfbde7-b87d-4804-af37-f502f0dfc451" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-a7dfbde7-b87d-4804-af37-f502f0dfc451" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8166e9f-1413-44b0-8289-f68b49f6a07a]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:14 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 Sep 25 17:26:14 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:14 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451" returned: 0 in 0.400s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:14 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451 Sep 25 17:26:14 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:14 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-a7dfbde7-b87d-4804-af37-f502f0dfc451" returned: 0 in 0.272s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-a7dfbde7-b87d-4804-af37-f502f0dfc451" released by "delete_volume" :: held 0.744s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Created reservations ['82752943-166d-4601-95ca-0dcac238830d', 'c167be8d-33cf-45be-96fd-adbf1fb8a53b', '4c7f4c34-5e34-4f3f-a0a4-fb797c0d672c', '945ff16c-eb23-4864-b9f3-90b834343a4f'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:14 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:26:14 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:15 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:15 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Deleted volume successfully. Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-468570bb-26d2-45bd-8417-b74cc4d96baa tempest-ProjectMemberTests-780059112 None] Lock "cinder-a7dfbde7-b87d-4804-af37-f502f0dfc451-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (dac2f875-978e-4d67-b238-4beaf3bb07fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadf149a-2014-4cdd-aa1a-6e6f6246c0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadf149a-2014-4cdd-aa1a-6e6f6246c0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908323277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363d5aa3-cdc3-45ee-b4bd-681301c2c66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:15Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a63d1c1-b27f-4dc4-ac2a-8cd563129550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a63d1c1-b27f-4dc4-ac2a-8cd563129550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8665f79a-fde5-4aae-82cb-8b6cf15ca785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8665f79a-fde5-4aae-82cb-8b6cf15ca785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '363d5aa3-cdc3-45ee-b4bd-681301c2c66f', 'volume_name': 'volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdca1313-2dc6-443e-9159-a3dc7398b692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdca1313-2dc6-443e-9159-a3dc7398b692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10fc5fb-1eb5-430c-acca-4eaaa467ba14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:15 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Volume 363d5aa3-cdc3-45ee-b4bd-681301c2c66f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f', 'volume_size': 1} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908323277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363d5aa3-cdc3-45ee-b4bd-681301c2c66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:15Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Creating volume 363d5aa3-cdc3-45ee-b4bd-681301c2c66f {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:15 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:26:15 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:15 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f 1073741824 Sep 25 17:26:15 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:16 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f 1073741824" returned: 0 in 0.459s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:16 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f Sep 25 17:26:16 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:16 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" returned: 0 in 0.270s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:16 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:16 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10fc5fb-1eb5-430c-acca-4eaaa467ba14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadfb0b2-a0fc-48ef-8ca5-9382aa4ad059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:16 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Volume volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f (363d5aa3-cdc3-45ee-b4bd-681301c2c66f): created successfully Sep 25 17:26:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dadfb0b2-a0fc-48ef-8ca5-9382aa4ad059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:16 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (dac2f875-978e-4d67-b238-4beaf3bb07fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:16 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bd7a7c89-66a3-419f-8767-a48881e73808 tempest-ProjectMemberTests-780059112 None] Created volume successfully. Sep 25 17:26:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:17 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Creating offline snapshot be33369f-56e4-4c7e-b956-df7a9443a830 of volume 363d5aa3-cdc3-45ee-b4bd-681301c2c66f {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:26:17 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[8323409a-b087-4978-a4b2-a0e85d9c8525]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:17 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:17 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f Sep 25 17:26:17 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:18 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" returned: 0 in 0.388s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:18 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 1G Sep 25 17:26:18 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:18 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 1G" returned: 0 in 0.446s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:18 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 Sep 25 17:26:18 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:18 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830" returned: 0 in 0.336s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:18 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 is being set with open permissions: ugo+rw Sep 25 17:26:18 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:18 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 Sep 25 17:26:18 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:19 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830" returned: 0 in 0.274s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:19 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.info Sep 25 17:26:19 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:19 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.info" returned: 0 in 0.276s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:19 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.info is being set with open permissions: ugo+rw Sep 25 17:26:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:19 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.info Sep 25 17:26:19 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:19 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.info" returned: 0 in 0.261s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:19 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:19 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-40523b6f-a658-42b5-a3f6-65b9e585ae66 tempest-ProjectMemberTests-780059112 None] Create snapshot completed successfully Sep 25 17:26:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-be33369f-56e4-4c7e-b956-df7a9443a830-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Lock "cinder-be33369f-56e4-4c7e-b956-df7a9443a830-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:20 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-be33369f-56e4-4c7e-b956-df7a9443a830" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-be33369f-56e4-4c7e-b956-df7a9443a830" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Deleting offline snapshot be33369f-56e4-4c7e-b956-df7a9443a830 of volume 363d5aa3-cdc3-45ee-b4bd-681301c2c66f {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] snapshot_file for this snap is: volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0c3a0-6f89-4c88-afe1-f07264b336e3]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=148,cinder:INSERT=52,cinder:UPDATE=205,cinder:DELETE=16 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:UPDATE=188,cinder:SELECT=148,cinder:INSERT=52,cinder:DELETE=17 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:26:21 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 Sep 25 17:26:21 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:21 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830" returned: 0 in 0.429s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2352055-abeb-400f-868b-938e453fe8dc]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:21 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f Sep 25 17:26:21 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:21 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" returned: 0 in 0.395s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:21 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:21 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 Sep 25 17:26:21 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:22 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830" returned: 0 in 0.347s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:22 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830 Sep 25 17:26:22 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:22 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:22 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f.be33369f-56e4-4c7e-b956-df7a9443a830" returned: 0 in 0.264s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-be33369f-56e4-4c7e-b956-df7a9443a830" released by "_delete_snapshot" :: held 1.556s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" released by "delete_snapshot" :: held 1.581s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:22 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Created reservations ['154eb27e-9029-408d-a232-e9fd86133c93', '485ae788-2dd4-4d67-a816-7984e98d49e5', '26b6d24b-71f2-4152-9a0f-41f520d2e606', '9efbd60f-4c4d-4b3d-b4a8-101c03bc5bde'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:22 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Delete snapshot completed successfully. Sep 25 17:26:22 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-ad563055-8fe5-48b4-ae9c-d8a4130847a0 tempest-ProjectMemberTests-780059112 None] Lock "cinder-be33369f-56e4-4c7e-b956-df7a9443a830-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-363d5aa3-cdc3-45ee-b4bd-681301c2c66f-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Lock "cinder-363d5aa3-cdc3-45ee-b4bd-681301c2c66f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" acquired by "delete_volume" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff546d3-5cf9-49c2-ba09-d717dbae06fa]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:23 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f Sep 25 17:26:23 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:23 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" returned: 0 in 0.411s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:23 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f Sep 25 17:26:23 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:23 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" returned: 0 in 0.263s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:23 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-363d5aa3-cdc3-45ee-b4bd-681301c2c66f" released by "delete_volume" :: held 0.744s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Created reservations ['5d201e48-95cf-4637-b849-7e19cc273ce9', '14a136f3-5006-4b56-83f6-9cec5d2f10cf', '52f28362-5b25-4f44-9204-de6893864b6b', '00e8e1d4-c677-4edb-818d-b01bd6d60fad'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:24 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:26:24 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:24 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.257s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:24 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Deleted volume successfully. Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-f136b5cc-9029-4903-8356-5321f4cb8745 tempest-ProjectMemberTests-780059112 None] Lock "cinder-363d5aa3-cdc3-45ee-b4bd-681301c2c66f-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (f9dcf3af-1225-4aed-8f50-607dd43bfb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1d78f5-21d5-460d-92d0-a3833ebefd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1d78f5-21d5-460d-92d0-a3833ebefd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11694565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9be96c-0326-4508-99de-d200f71b8f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:25Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91bfa0a-d6a5-4981-87b3-88adf720ba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91bfa0a-d6a5-4981-87b3-88adf720ba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7e12ff-3776-4388-99fb-ec3efa007ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7e12ff-3776-4388-99fb-ec3efa007ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9be96c-0326-4508-99de-d200f71b8f20', 'volume_name': 'volume-8b9be96c-0326-4508-99de-d200f71b8f20', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9739bf4e-4f37-4451-8ba3-d5ba74e51600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9739bf4e-4f37-4451-8ba3-d5ba74e51600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8374ce9-6d72-4f0e-bfbd-a414957ed5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:24 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Volume 8b9be96c-0326-4508-99de-d200f71b8f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9be96c-0326-4508-99de-d200f71b8f20', 'volume_size': 1} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11694565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9be96c-0326-4508-99de-d200f71b8f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:25Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Creating volume 8b9be96c-0326-4508-99de-d200f71b8f20 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:24 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:26:24 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:24 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 1073741824 Sep 25 17:26:24 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:25 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 1073741824" returned: 0 in 0.572s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:25 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 Sep 25 17:26:25 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:25 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20" returned: 0 in 0.314s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:25 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:25 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8374ce9-6d72-4f0e-bfbd-a414957ed5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9be96c-0326-4508-99de-d200f71b8f20', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebac08d5-b496-4678-b89a-a4bc17b55047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:25 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Volume volume-8b9be96c-0326-4508-99de-d200f71b8f20 (8b9be96c-0326-4508-99de-d200f71b8f20): created successfully Sep 25 17:26:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebac08d5-b496-4678-b89a-a4bc17b55047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:25 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (f9dcf3af-1225-4aed-8f50-607dd43bfb93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:25 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6e28c320-f9bc-478f-bafb-e16ab858247e tempest-ProjectMemberTests-780059112 None] Created volume successfully. Sep 25 17:26:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:27 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Creating offline snapshot 872113d0-1261-4484-ab8e-e2b3ffc44199 of volume 8b9be96c-0326-4508-99de-d200f71b8f20 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:26:27 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[52186cbf-3a9f-40a5-b4e7-69e4873d0285]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:27 devstack sudo[109421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 Sep 25 17:26:27 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:27 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20" returned: 0 in 0.422s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:27 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:27 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 1G Sep 25 17:26:27 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:28 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 1G" returned: 0 in 0.480s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b9be96c-0326-4508-99de-d200f71b8f20 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:28 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b9be96c-0326-4508-99de-d200f71b8f20 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 Sep 25 17:26:28 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:28 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b9be96c-0326-4508-99de-d200f71b8f20 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199" returned: 0 in 0.342s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:28 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 is being set with open permissions: ugo+rw Sep 25 17:26:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:28 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 Sep 25 17:26:28 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:28 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199" returned: 0 in 0.255s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:28 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:28 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.info Sep 25 17:26:28 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:29 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.info" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:29 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.info is being set with open permissions: ugo+rw Sep 25 17:26:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:29 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.info Sep 25 17:26:29 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:29 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.info" returned: 0 in 0.255s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:29 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:29 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-ead1e1a8-2c72-4acd-b5c3-ede01a001696 tempest-ProjectMemberTests-780059112 None] Create snapshot completed successfully Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-872113d0-1261-4484-ab8e-e2b3ffc44199-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Lock "cinder-872113d0-1261-4484-ab8e-e2b3ffc44199-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-8b9be96c-0326-4508-99de-d200f71b8f20" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-8b9be96c-0326-4508-99de-d200f71b8f20" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-872113d0-1261-4484-ab8e-e2b3ffc44199" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-872113d0-1261-4484-ab8e-e2b3ffc44199" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Deleting offline snapshot 872113d0-1261-4484-ab8e-e2b3ffc44199 of volume 8b9be96c-0326-4508-99de-d200f71b8f20 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] snapshot_file for this snap is: volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[037412bd-d405-4e1a-b9ed-ae17e8557bba]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:30 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 Sep 25 17:26:30 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:30 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199" returned: 0 in 0.420s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b9be96c-0326-4508-99de-d200f71b8f20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7378427-45e4-47f5-8907-346b65a4c4dc]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:30 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:31 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 Sep 25 17:26:31 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:31 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20" returned: 0 in 0.409s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:31 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 Sep 25 17:26:31 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:31 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199" returned: 0 in 0.401s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:31 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:31 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199 Sep 25 17:26:31 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:32 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20.872113d0-1261-4484-ab8e-e2b3ffc44199" returned: 0 in 0.298s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-872113d0-1261-4484-ab8e-e2b3ffc44199" released by "_delete_snapshot" :: held 1.657s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-8b9be96c-0326-4508-99de-d200f71b8f20" released by "delete_snapshot" :: held 1.683s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Created reservations ['bc651bd3-ba08-4f3e-ad67-f32ad3fca4ab', 'c3691d6d-5c8f-4eef-b583-aec63d2532c6', 'ed4088ae-00b7-4eeb-b05b-2fe8ce1ee88a', '0146ea37-f310-4141-8eb7-4a0c5c43cbc4'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:32 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Delete snapshot completed successfully. Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-91804e57-ab85-4ee7-997a-086a793b0bd2 tempest-ProjectMemberTests-780059112 None] Lock "cinder-872113d0-1261-4484-ab8e-e2b3ffc44199-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-8b9be96c-0326-4508-99de-d200f71b8f20-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Lock "cinder-8b9be96c-0326-4508-99de-d200f71b8f20-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-8b9be96c-0326-4508-99de-d200f71b8f20" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-8b9be96c-0326-4508-99de-d200f71b8f20" acquired by "delete_volume" :: waited 0.018s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb360135-87b4-46a6-a78f-a25f667803c6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:32 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:32 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 Sep 25 17:26:32 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:33 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20" returned: 0 in 0.470s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:33 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20 Sep 25 17:26:33 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:33 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8b9be96c-0326-4508-99de-d200f71b8f20" returned: 0 in 0.271s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-8b9be96c-0326-4508-99de-d200f71b8f20" released by "delete_volume" :: held 0.819s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Created reservations ['10a2e38a-58ee-4be8-81e8-b0c1756478b1', '0804040d-2719-4f47-aab3-46ed16d269ae', '883520cb-99d4-493b-b1cf-bafaa68b24d8', '9456a89c-97dd-41c0-9bb3-4d0e7076c213'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:33 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:26:33 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:33 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:33 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Deleted volume successfully. Sep 25 17:26:33 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-8829e47c-3ad1-4064-8c27-8ea924c0e4e1 tempest-ProjectMemberTests-780059112 None] Lock "cinder-8b9be96c-0326-4508-99de-d200f71b8f20-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (c7c9e188-4cb3-4303-8dc1-34e21717f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a60a443-f615-40cf-a2a3-7e415d5d3ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a60a443-f615-40cf-a2a3-7e415d5d3ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800745643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c78eb1b-a68b-4c41-98a1-90d87fb71d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:34Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa8b3d6-3ecc-43d7-bf0e-382ef5cda7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa8b3d6-3ecc-43d7-bf0e-382ef5cda7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc39a74a-c47f-481e-bd2d-d8b51755e39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc39a74a-c47f-481e-bd2d-d8b51755e39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c78eb1b-a68b-4c41-98a1-90d87fb71d63', 'volume_name': 'volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981bf0f7-0ea6-4d18-b02f-5558b82474a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981bf0f7-0ea6-4d18-b02f-5558b82474a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb0d78e-4d13-4b95-9eff-e7600bce22a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:34 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Volume 8c78eb1b-a68b-4c41-98a1-90d87fb71d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63', 'volume_size': 1} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800745643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c78eb1b-a68b-4c41-98a1-90d87fb71d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:34Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Creating volume 8c78eb1b-a68b-4c41-98a1-90d87fb71d63 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:34 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:34 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 1073741824 Sep 25 17:26:34 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:34 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 1073741824" returned: 0 in 0.482s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:34 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:34 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 Sep 25 17:26:34 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:35 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" returned: 0 in 0.301s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:35 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:35 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb0d78e-4d13-4b95-9eff-e7600bce22a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d61509-f2db-41f4-b651-359e522eadc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:35 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Volume volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 (8c78eb1b-a68b-4c41-98a1-90d87fb71d63): created successfully Sep 25 17:26:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d61509-f2db-41f4-b651-359e522eadc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:35 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (c7c9e188-4cb3-4303-8dc1-34e21717f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:35 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-203084a0-02b4-445d-b599-ac4bb4e5e40d tempest-ProjectMemberTests-780059112 None] Created volume successfully. Sep 25 17:26:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:36 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Creating offline snapshot 30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 of volume 8c78eb1b-a68b-4c41-98a1-90d87fb71d63 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:26:36 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[966039e3-1c63-4ef4-bcf2-8d514b01672b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:36 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:36 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 Sep 25 17:26:36 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:37 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" returned: 0 in 0.506s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:37 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 1G Sep 25 17:26:37 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:37 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 1G" returned: 0 in 0.651s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:37 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:37 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 Sep 25 17:26:37 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:38 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114" returned: 0 in 0.370s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:38 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 is being set with open permissions: ugo+rw Sep 25 17:26:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:38 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 Sep 25 17:26:38 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:38 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114" returned: 0 in 0.297s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:38 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.info Sep 25 17:26:38 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:38 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.info" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:38 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.info is being set with open permissions: ugo+rw Sep 25 17:26:38 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:38 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.info Sep 25 17:26:38 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:39 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.info" returned: 0 in 0.357s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:39 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3da50265-3ddd-49d9-a781-a38c8eeafbd8 tempest-ProjectMemberTests-780059112 None] Create snapshot completed successfully Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-30f7e3c6-dbe4-4f89-bb66-0f548f8ca114-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-30f7e3c6-dbe4-4f89-bb66-0f548f8ca114-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-30f7e3c6-dbe4-4f89-bb66-0f548f8ca114" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-30f7e3c6-dbe4-4f89-bb66-0f548f8ca114" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Deleting offline snapshot 30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 of volume 8c78eb1b-a68b-4c41-98a1-90d87fb71d63 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] snapshot_file for this snap is: volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83c4da-4d88-40f0-b611-70b399fce327]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:39 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:40 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 Sep 25 17:26:40 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:40 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114" returned: 0 in 0.407s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ae603b-9845-4ff9-a9d6-ea520451ea7c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Flow 'volume_create_manager' (f4c0179c-20c2-4150-95f2-b85e061aeade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e106bb7-d7ee-4ed1-aeff-5b4f89a5102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e106bb7-d7ee-4ed1-aeff-5b4f89a5102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2035155606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538fd7c9-e060-4617-af97-59e50b198e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1978c922931646b39df35ab0c2c0f12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:40Z,use_quota=True,user_id='730f8bbcaefc42728b28f6df0b32a40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d545b94a-c96a-4029-9f49-13d08e04c544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d545b94a-c96a-4029-9f49-13d08e04c544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802a757a-68d9-42d1-8182-aa189f226b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802a757a-68d9-42d1-8182-aa189f226b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538fd7c9-e060-4617-af97-59e50b198e42', 'volume_name': 'volume-538fd7c9-e060-4617-af97-59e50b198e42', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5693644-2c30-41c8-a8c8-e4849df74f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5693644-2c30-41c8-a8c8-e4849df74f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068272d8-b609-4804-a430-799762e74b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:40 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Volume 538fd7c9-e060-4617-af97-59e50b198e42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538fd7c9-e060-4617-af97-59e50b198e42', 'volume_size': 1} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2035155606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538fd7c9-e060-4617-af97-59e50b198e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1978c922931646b39df35ab0c2c0f12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:40Z,use_quota=True,user_id='730f8bbcaefc42728b28f6df0b32a40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Creating volume 538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:40 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:40 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 Sep 25 17:26:40 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:40 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 1073741824 Sep 25 17:26:40 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:40 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" returned: 0 in 0.385s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:40 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:40 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 Sep 25 17:26:40 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:41 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 1073741824" returned: 0 in 0.493s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:41 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 Sep 25 17:26:41 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:41 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114" returned: 0 in 0.377s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:41 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114 Sep 25 17:26:41 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:41 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42" returned: 0 in 0.272s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068272d8-b609-4804-a430-799762e74b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538fd7c9-e060-4617-af97-59e50b198e42', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8a1f9f-98ec-4e25-a45d-9f9bb953db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:41 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Volume volume-538fd7c9-e060-4617-af97-59e50b198e42 (538fd7c9-e060-4617-af97-59e50b198e42): created successfully Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8a1f9f-98ec-4e25-a45d-9f9bb953db9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Flow 'volume_create_manager' (f4c0179c-20c2-4150-95f2-b85e061aeade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3ec2abc0-05c0-41a3-84f3-bcb3bfb99643 tempest-SnapshotDependencyTests-730885998 None] Created volume successfully. Sep 25 17:26:41 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63.30f7e3c6-dbe4-4f89-bb66-0f548f8ca114" returned: 0 in 0.272s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-30f7e3c6-dbe4-4f89-bb66-0f548f8ca114" released by "_delete_snapshot" :: held 1.549s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" released by "delete_snapshot" :: held 1.575s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Created reservations ['aa6b4636-1691-4e74-93cf-a5ecb6d3d5ac', 'ed0d3b84-2171-4b0c-bd22-e2e586f08763', '1b296ad6-4e4e-4ab6-bf77-c99a52f74b3d', '2da67ce3-52d0-41dc-96ed-1683def7a50c'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:41 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Delete snapshot completed successfully. Sep 25 17:26:41 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-4f367bc4-f2f6-47ac-967f-34d702185cc4 tempest-ProjectMemberTests-780059112 None] Lock "cinder-30f7e3c6-dbe4-4f89-bb66-0f548f8ca114-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-8c78eb1b-a68b-4c41-98a1-90d87fb71d63-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Lock "cinder-8c78eb1b-a68b-4c41-98a1-90d87fb71d63-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee47c74-2a95-42ac-bf77-dc2498572d5f]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:42 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 Sep 25 17:26:42 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:42 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" returned: 0 in 0.378s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:42 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63 Sep 25 17:26:42 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Creating offline snapshot 7d731a35-2046-4b8b-a5fc-94cc78b81e6d of volume 538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c727b99-17b0-49fd-9a5c-31699131efef]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:42 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" returned: 0 in 0.309s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-8c78eb1b-a68b-4c41-98a1-90d87fb71d63" released by "delete_volume" :: held 0.749s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:42 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 Sep 25 17:26:42 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Created reservations ['8d523f53-4cd7-415a-959a-8547064f46e6', 'd63a5204-62de-4aff-8fb0-ef4fe46d267c', 'a955e20f-bf78-4a8f-a26e-a7fcd7e43224', '00d0358f-ea2e-4333-bc4f-afc2c3798527'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:42 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:43 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:26:43 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:43 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42" returned: 0 in 0.408s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:43 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d 1G Sep 25 17:26:43 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:43 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.303s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:43 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Deleted volume successfully. Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3a6d184c-14b7-4693-b821-1424b601aa62 tempest-ProjectMemberTests-780059112 None] Lock "cinder-8c78eb1b-a68b-4c41-98a1-90d87fb71d63-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:43 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d 1G" returned: 0 in 0.466s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-538fd7c9-e060-4617-af97-59e50b198e42 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:43 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-538fd7c9-e060-4617-af97-59e50b198e42 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d Sep 25 17:26:43 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (e8c932bf-6ec9-4a08-890d-e8432b25408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4559feda-6c81-4863-bc2c-7c5c3fd26af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4559feda-6c81-4863-bc2c-7c5c3fd26af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417729350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f066d4-b5fe-4d71-8f03-968241088887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:44Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb348f6-2626-4b59-939c-2a84e5e22e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb348f6-2626-4b59-939c-2a84e5e22e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac31e07-b0eb-4a6c-8912-beb9037c4cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac31e07-b0eb-4a6c-8912-beb9037c4cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f066d4-b5fe-4d71-8f03-968241088887', 'volume_name': 'volume-78f066d4-b5fe-4d71-8f03-968241088887', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0230ad-733d-4403-ad4a-e806a4273c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0230ad-733d-4403-ad4a-e806a4273c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799e5c27-9382-4de8-82ba-3345bc35cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:43 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Volume 78f066d4-b5fe-4d71-8f03-968241088887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f066d4-b5fe-4d71-8f03-968241088887', 'volume_size': 1} Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:43 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-538fd7c9-e060-4617-af97-59e50b198e42 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d" returned: 0 in 0.304s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:43 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d is being set with open permissions: ugo+rw Sep 25 17:26:43 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:43 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d Sep 25 17:26:43 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:44 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d" returned: 0 in 0.246s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:44 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.info Sep 25 17:26:44 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:44 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.info" returned: 0 in 0.254s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:44 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.info is being set with open permissions: ugo+rw Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:44 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.info Sep 25 17:26:44 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:44 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.info" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417729350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f066d4-b5fe-4d71-8f03-968241088887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:44Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Creating volume 78f066d4-b5fe-4d71-8f03-968241088887 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:44 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:26:44 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:44 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 1073741824 Sep 25 17:26:44 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:44 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3e9684b7-9e31-4e03-8c90-173b0e2643be tempest-SnapshotDependencyTests-730885998 None] Create snapshot completed successfully Sep 25 17:26:45 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 1073741824" returned: 0 in 0.438s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:45 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 Sep 25 17:26:45 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:45 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887" returned: 0 in 0.256s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799e5c27-9382-4de8-82ba-3345bc35cea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f066d4-b5fe-4d71-8f03-968241088887', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb3ae9d-f747-4a23-a21d-07c35851c00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:45 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Volume volume-78f066d4-b5fe-4d71-8f03-968241088887 (78f066d4-b5fe-4d71-8f03-968241088887): created successfully Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb3ae9d-f747-4a23-a21d-07c35851c00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (e8c932bf-6ec9-4a08-890d-e8432b25408e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:45 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-c0a252a4-519d-4dcb-8824-60f250f88e47 tempest-ProjectMemberTests-780059112 None] Created volume successfully. Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:45 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Creating offline snapshot 50eec2d8-8caf-468d-ac62-82d5cedcbdc3 of volume 78f066d4-b5fe-4d71-8f03-968241088887 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03657f1-3702-4d3c-9ac8-91afa4b40ef6]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:46 devstack sudo[109588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 Sep 25 17:26:46 devstack sudo[109588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:46 devstack sudo[109588]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887" returned: 0 in 0.428s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:46 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 1G Sep 25 17:26:46 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Flow 'volume_create_manager' (54c8f6ac-06d2-4f14-958f-9912cf5516b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a9ac9c-c9dd-492a-b5e5-bd2d4face895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a9ac9c-c9dd-492a-b5e5-bd2d4face895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1978c922931646b39df35ab0c2c0f12d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d731a35-2046-4b8b-a5fc-94cc78b81e6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:46Z,use_quota=True,user_id='730f8bbcaefc42728b28f6df0b32a40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bcdd72-110f-4d3e-b11f-adad7e4151dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4bcdd72-110f-4d3e-b11f-adad7e4151dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6ba15c-97e7-420f-a08d-bdb59a195c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f6ba15c-97e7-420f-a08d-bdb59a195c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7', 'volume_name': 'volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7', 'volume_size': 1, 'snapshot_id': '7d731a35-2046-4b8b-a5fc-94cc78b81e6d'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45329f2c-f39c-42d7-b0af-f48ff01fd19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45329f2c-f39c-42d7-b0af-f48ff01fd19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fe766b-9e74-44f8-b2ee-dc8174ad1a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:46 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Volume 60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7', 'volume_size': 1, 'snapshot_id': '7d731a35-2046-4b8b-a5fc-94cc78b81e6d'} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:46 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 1G" returned: 0 in 0.405s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:46 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f066d4-b5fe-4d71-8f03-968241088887 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:46 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f066d4-b5fe-4d71-8f03-968241088887 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 Sep 25 17:26:46 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:47 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f066d4-b5fe-4d71-8f03-968241088887 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3" returned: 0 in 0.281s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:47 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 is being set with open permissions: ugo+rw Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:47 devstack sudo[109604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 Sep 25 17:26:47 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:47 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3" returned: 0 in 0.234s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:47 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.info Sep 25 17:26:47 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:47 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.info" returned: 0 in 0.260s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:47 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.info is being set with open permissions: ugo+rw Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:47 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.info Sep 25 17:26:47 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:47 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.info" returned: 0 in 0.250s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.291s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "cinder-quobyte-7d731a35-2046-4b8b-a5fc-94cc78b81e6d-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" by "_create_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-7d731a35-2046-4b8b-a5fc-94cc78b81e6d-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Creating volume 60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 from snapshot 7d731a35-2046-4b8b-a5fc-94cc78b81e6d {{(pid=87232) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "cinder-quobyte-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" by "_copy_volume_from_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:47 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-99b9b9ef-43d0-46c5-9a67-1cf6a802ede8 tempest-ProjectMemberTests-780059112 None] Create snapshot completed successfully Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:47 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] snapshot: 7d731a35-2046-4b8b-a5fc-94cc78b81e6d, volume: 60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7, {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[51444820-8ee5-4b7f-b57c-75c9d8cfbb6c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-50eec2d8-8caf-468d-ac62-82d5cedcbdc3-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Lock "cinder-50eec2d8-8caf-468d-ac62-82d5cedcbdc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-78f066d4-b5fe-4d71-8f03-968241088887" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:48 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d Sep 25 17:26:48 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-78f066d4-b5fe-4d71-8f03-968241088887" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-50eec2d8-8caf-468d-ac62-82d5cedcbdc3" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-50eec2d8-8caf-468d-ac62-82d5cedcbdc3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Deleting offline snapshot 50eec2d8-8caf-468d-ac62-82d5cedcbdc3 of volume 78f066d4-b5fe-4d71-8f03-968241088887 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] snapshot_file for this snap is: volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[798c4eb5-498c-4710-bcd5-937aee782a42]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:48 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 Sep 25 17:26:48 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:48 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d" returned: 0 in 0.393s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-538fd7c9-e060-4617-af97-59e50b198e42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[7badcdfa-c1bb-44f0-891d-58bf12ced47e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:48 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 Sep 25 17:26:48 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:48 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3" returned: 0 in 0.372s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78f066d4-b5fe-4d71-8f03-968241088887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce1e13-bf35-4ed6-b2d4-593789d6d5f4]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:48 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 Sep 25 17:26:48 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:48 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42" returned: 0 in 0.416s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Creating direct copy from snapshot {{(pid=87232) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG cinder.utils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Path /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 not found in is_blk_device check {{(pid=87232) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 17:26:48 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:48 devstack sudo[109630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 Sep 25 17:26:48 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:49 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887" returned: 0 in 0.393s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:49 devstack sudo[109635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 Sep 25 17:26:49 devstack sudo[109635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:49 devstack sudo[109635]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3" returned: 0 in 0.503s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:49 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:49 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3 Sep 25 17:26:49 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:50 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:50 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887.50eec2d8-8caf-468d-ac62-82d5cedcbdc3" returned: 0 in 0.492s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-50eec2d8-8caf-468d-ac62-82d5cedcbdc3" released by "_delete_snapshot" :: held 1.908s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-78f066d4-b5fe-4d71-8f03-968241088887" released by "delete_snapshot" :: held 1.933s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:50 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Created reservations ['f87525e6-8c3e-4499-b259-1357b3a6914f', '9a52811d-4d92-4e54-aefe-320ffdb3dcc8', 'ad7c530b-da2c-496b-ae53-899046aaf1fc', 'ed51ca90-06dc-4177-92b7-53233bd97d54'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:50 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Delete snapshot completed successfully. Sep 25 17:26:50 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-e812be15-4aef-4d93-b7af-a2b8fe2cb230 tempest-ProjectMemberTests-780059112 None] Lock "cinder-50eec2d8-8caf-468d-ac62-82d5cedcbdc3-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-78f066d4-b5fe-4d71-8f03-968241088887-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Lock "cinder-78f066d4-b5fe-4d71-8f03-968241088887-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-78f066d4-b5fe-4d71-8f03-968241088887" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:51 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-78f066d4-b5fe-4d71-8f03-968241088887" acquired by "delete_volume" :: waited 0.037s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:51 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d4081-cb95-4422-aa84-156788fcffc9]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:51 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:51 devstack sudo[109654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 Sep 25 17:26:51 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:52 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887" returned: 0 in 0.600s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:52 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887 Sep 25 17:26:52 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:52 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:52 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-78f066d4-b5fe-4d71-8f03-968241088887" returned: 0 in 0.547s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:52 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-78f066d4-b5fe-4d71-8f03-968241088887" released by "delete_volume" :: held 1.291s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:52 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Created reservations ['dba24136-6bba-48d2-8d00-2153be7104ac', 'c539f9a8-4dd3-4af1-84b0-4fc6dbb0daf6', '901c22c5-6930-4202-a7e8-58f85b277e7b', '61088b3f-2b47-4ef1-8303-95cafbb6750a'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:53 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:53 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:26:53 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:53 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:53 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.377s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:53 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:53 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Deleted volume successfully. Sep 25 17:26:53 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-bfb69b1c-3101-4ca3-b3ac-487962d78618 tempest-ProjectMemberTests-780059112 None] Lock "cinder-78f066d4-b5fe-4d71-8f03-968241088887-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (9b60c2fb-e026-47bb-8a24-10b92bce2a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f14025e-ccb8-47bd-b82c-c8168036920d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f14025e-ccb8-47bd-b82c-c8168036920d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143258989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289d3525-96f9-49e1-a2a8-1a7e6eb484d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:54Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7219cbb2-e163-4012-bb36-b7b87aaae505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7219cbb2-e163-4012-bb36-b7b87aaae505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3cf1fd-dd41-461f-a015-970e3791e12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3cf1fd-dd41-461f-a015-970e3791e12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '289d3525-96f9-49e1-a2a8-1a7e6eb484d4', 'volume_name': 'volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b25ef2-5df2-4934-8f3a-116e345eb299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b25ef2-5df2-4934-8f3a-116e345eb299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64499e2d-370b-459e-9b12-bde3ccfbf9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:54 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Volume 289d3525-96f9-49e1-a2a8-1a7e6eb484d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4', 'volume_size': 1} Sep 25 17:26:54 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:55 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" returned: 0 in 6.446s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.image.image_utils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 {{(pid=87232) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 17:26:55 devstack cinder-volume[87232]: INFO cinder.image.image_utils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Converted 1024.00 MB image at 158.83 MB/s Sep 25 17:26:55 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 is being set with open permissions: ugo+rw Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:55 devstack sudo[109671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 Sep 25 17:26:55 devstack sudo[109671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:55 devstack sudo[109671]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" returned: 0 in 0.241s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" released by "_copy_volume_from_snapshot" :: held 7.606s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-7d731a35-2046-4b8b-a5fc-94cc78b81e6d-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" released by "_create_volume_from_snapshot" :: held 7.670s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.690s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.031s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143258989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289d3525-96f9-49e1-a2a8-1a7e6eb484d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f7cf58e06b4c71aaab1e3773872885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:26:54Z,use_quota=True,user_id='84c2d06b3fa9440a8dce20cdc7218128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Creating volume 289d3525-96f9-49e1-a2a8-1a7e6eb484d4 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:26:55 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:55 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 1073741824 Sep 25 17:26:55 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fe766b-9e74-44f8-b2ee-dc8174ad1a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7', 'volume_size': 1, 'snapshot_id': '7d731a35-2046-4b8b-a5fc-94cc78b81e6d'}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5d0560-649f-4613-8cf3-2cfc438ffae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:55 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Volume volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 (60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7): created successfully Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5d0560-649f-4613-8cf3-2cfc438ffae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:55 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Flow 'volume_create_manager' (54c8f6ac-06d2-4f14-958f-9912cf5516b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:55 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-3291272b-1688-4f95-96bb-0f28c010bc79 tempest-SnapshotDependencyTests-730885998 None] Created volume successfully. Sep 25 17:26:56 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 1073741824" returned: 0 in 0.415s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:56 devstack sudo[109680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 Sep 25 17:26:56 devstack sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:56 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:26:56 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:56 devstack sudo[109680]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "cinder-7d731a35-2046-4b8b-a5fc-94cc78b81e6d-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" returned: 0 in 0.279s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-7d731a35-2046-4b8b-a5fc-94cc78b81e6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "cinder-quobyte-538fd7c9-e060-4617-af97-59e50b198e42" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64499e2d-370b-459e-9b12-bde3ccfbf9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb2a505-0783-4f29-8cbc-99d1eba5587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:26:56 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.261s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_service.periodic_task [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] Running periodic task VolumeManager._thread_info {{(pid=87232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread count: 29 {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-9664286c-ff79-420d-ba45-6461fccfbfb9 None None] thread info: [<_MainThread(MainThread, started 139428426686592)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 17:26:56 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Volume volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 (289d3525-96f9-49e1-a2a8-1a7e6eb484d4): created successfully Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb2a505-0783-4f29-8cbc-99d1eba5587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Flow 'volume_create_manager' (9b60c2fb-e026-47bb-8a24-10b92bce2a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-538fd7c9-e060-4617-af97-59e50b198e42" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "cinder-quobyte-7d731a35-2046-4b8b-a5fc-94cc78b81e6d" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:56 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-19f3dec4-2837-401e-8b1e-d30d0167257a tempest-ProjectMemberTests-780059112 None] Created volume successfully. Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-7d731a35-2046-4b8b-a5fc-94cc78b81e6d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Deleting offline snapshot 7d731a35-2046-4b8b-a5fc-94cc78b81e6d of volume 538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] snapshot_file for this snap is: volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[362d2629-0bee-4944-a475-48e20607e946]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:56 devstack sudo[109686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d Sep 25 17:26:56 devstack sudo[109686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:56 devstack sudo[109686]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-538fd7c9-e060-4617-af97-59e50b198e42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a53bd8-e0e4-4f89-86b4-afc722299015]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:56 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:56 devstack sudo[109691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 Sep 25 17:26:56 devstack sudo[109691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:57 devstack sudo[109691]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42" returned: 0 in 0.526s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:57 devstack sudo[109697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d Sep 25 17:26:57 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:57 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Creating offline snapshot 3f19527c-cda7-434e-a84c-705f4b52ca73 of volume 289d3525-96f9-49e1-a2a8-1a7e6eb484d4 {{(pid=87232) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 17:26:57 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b76d51-3c6f-42d4-84c2-c233a1fcb385]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:57 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d" returned: 0 in 0.358s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:57 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:57 devstack sudo[109704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d Sep 25 17:26:57 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:57 devstack sudo[109703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 Sep 25 17:26:57 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:58 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42.7d731a35-2046-4b8b-a5fc-94cc78b81e6d" returned: 0 in 0.253s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-7d731a35-2046-4b8b-a5fc-94cc78b81e6d" released by "_delete_snapshot" :: held 1.602s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-538fd7c9-e060-4617-af97-59e50b198e42" released by "delete_snapshot" :: held 1.632s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:58 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" returned: 0 in 0.387s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 1G {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Created reservations ['06f70ab5-8a94-4a02-a71c-2cd423138395', '8653c266-08e8-48ba-8816-a49d0461bcf9', 'feee5e35-794f-43b5-b728-d0603df74f9f', '78a40a2a-8e8d-4909-8b64-9ade0fd26918'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:58 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 1G Sep 25 17:26:58 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:58 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Delete snapshot completed successfully. Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6f9991c8-4783-4cd7-a7fc-4b8afe833016 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-7d731a35-2046-4b8b-a5fc-94cc78b81e6d-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:58 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "cinder-538fd7c9-e060-4617-af97-59e50b198e42-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 1G" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-538fd7c9-e060-4617-af97-59e50b198e42-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:58 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 Sep 25 17:26:58 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "cinder-quobyte-538fd7c9-e060-4617-af97-59e50b198e42" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-538fd7c9-e060-4617-af97-59e50b198e42" acquired by "delete_volume" :: waited 0.022s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[214d2df6-a771-42e2-9707-7e875cac3f3b]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:58 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 Sep 25 17:26:58 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:58 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 -F qcow2 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73" returned: 0 in 0.319s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:58 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 is being set with open permissions: ugo+rw Sep 25 17:26:58 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:58 devstack sudo[109724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 Sep 25 17:26:58 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:59 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42" returned: 0 in 0.373s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:59 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42 Sep 25 17:26:59 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:59 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73" returned: 0 in 0.262s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:59 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.info Sep 25 17:26:59 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:59 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-538fd7c9-e060-4617-af97-59e50b198e42" returned: 0 in 0.240s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-538fd7c9-e060-4617-af97-59e50b198e42" released by "delete_volume" :: held 0.682s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Created reservations ['7f3b853d-d98f-4209-854f-27314d67aec2', 'dafd4448-81ae-439d-9b32-efce391a213e', '741544f5-c9d0-4e19-9e14-bf0dfbbc9907', '2ec43709-af8f-4586-967c-1a6b47a9ede3'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:26:59 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.info" returned: 0 in 0.258s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:59 devstack cinder-volume[87232]: WARNING cinder.volume.drivers.remotefs [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.info is being set with open permissions: ugo+rw Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.info {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:59 devstack sudo[109736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.info Sep 25 17:26:59 devstack sudo[109736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:59 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:26:59 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:26:59 devstack sudo[109736]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.info" returned: 0 in 0.252s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:26:59 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "cinder-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Deleted volume successfully. Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:59 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-a58b9b97-9491-4d36-a8d2-21574c983274 tempest-ProjectMemberTests-780059112 None] Create snapshot completed successfully Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-cec22ed4-eb20-4c98-9bcf-c111a6e24618 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-538fd7c9-e060-4617-af97-59e50b198e42-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "cinder-quobyte-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80be15a-e14f-4706-8591-4f5871c9ef0e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:26:59 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:26:59 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 Sep 25 17:26:59 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:00 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" returned: 0 in 0.352s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:00 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7 Sep 25 17:27:00 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:00 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" returned: 0 in 0.245s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-quobyte-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7" released by "delete_volume" :: held 0.640s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Created reservations ['1860a2ce-ead5-44c7-8406-85a07b84ca0a', 'a911bc8d-cc7b-4c3d-932c-a6878e7a762d', '3b384e5c-f753-47ee-bc0c-34f451774725', '07fc5094-e8b8-4b99-801b-dd954a793e64'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:00 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:27:00 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:00 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.250s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:27:00 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Deleted volume successfully. Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-013edc04-a7e7-42e6-a777-ac779ee85d97 tempest-SnapshotDependencyTests-730885998 None] Lock "cinder-60d09cd9-d1e3-4ad4-9ccc-6bec9f6d4da7-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:00 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-3f19527c-cda7-434e-a84c-705f4b52ca73-delete_snapshot" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Lock "cinder-3f19527c-cda7-434e-a84c-705f4b52ca73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" by "delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-3f19527c-cda7-434e-a84c-705f4b52ca73" by "_delete_snapshot" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-3f19527c-cda7-434e-a84c-705f4b52ca73" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Deleting offline snapshot 3f19527c-cda7-434e-a84c-705f4b52ca73 of volume 289d3525-96f9-49e1-a2a8-1a7e6eb484d4 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] snapshot_file for this snap is: volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 {{(pid=87232) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb162e-81a0-4263-8d64-4166a4f4bf88]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:01 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 Sep 25 17:27:01 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:01 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73" returned: 0 in 0.379s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87232) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[603f8d37-f50e-4537-88ed-7f4b7cf6054c]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:01 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 Sep 25 17:27:01 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:01 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" returned: 0 in 0.406s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:01 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:01 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 Sep 25 17:27:01 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:02 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73" returned: 0 in 0.346s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:02 devstack sudo[109768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73 Sep 25 17:27:02 devstack sudo[109768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:02 devstack sudo[109768]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:02 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4.3f19527c-cda7-434e-a84c-705f4b52ca73" returned: 0 in 0.282s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-3f19527c-cda7-434e-a84c-705f4b52ca73" released by "_delete_snapshot" :: held 1.540s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" released by "delete_snapshot" :: held 1.560s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:02 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Created reservations ['f508856d-317e-4a92-b7dc-cfc890fce8cc', '0bcd75a7-7b07-42e4-904b-6dddce46270c', 'f56ba2b0-cdd6-44cc-a077-7ab518dbf4e8', '0d21d4f4-e3e9-43f7-9ced-167db683114d'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:27:02 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Delete snapshot completed successfully. Sep 25 17:27:02 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-7fcf9519-1ddf-4280-82b3-f74ede5d2997 tempest-ProjectMemberTests-780059112 None] Lock "cinder-3f19527c-cda7-434e-a84c-705f4b52ca73-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-289d3525-96f9-49e1-a2a8-1a7e6eb484d4-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Lock "cinder-289d3525-96f9-49e1-a2a8-1a7e6eb484d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Acquiring lock "cinder-quobyte-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" acquired by "delete_volume" :: waited 0.016s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[45053c87-f5e0-48b2-b088-cb681ad89e8e]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:03 devstack sudo[109772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 Sep 25 17:27:03 devstack sudo[109772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:03 devstack sudo[109772]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" returned: 0 in 0.393s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:03 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4 Sep 25 17:27:03 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:03 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" returned: 0 in 0.239s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Lock "cinder-quobyte-289d3525-96f9-49e1-a2a8-1a7e6eb484d4" released by "delete_volume" :: held 0.699s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:03 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Created reservations ['2a8c0c3c-a723-455e-aa57-ecb87e19996d', '2c6b3d1c-be18-46e5-9c0f-7e7743ce323f', 'fbb048ca-6d97-429d-aaa0-a1ff5f1b2a4e', '34acc1b5-8ff9-4fda-9e0d-c8ca89191f4e'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:27:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:27:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:27:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:27:04 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:27:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:27:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:04 devstack sudo[109780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:27:04 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:04 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:04 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.259s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:04 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:27:04 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Deleted volume successfully. Sep 25 17:27:04 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-da6d5cc2-6e70-4e49-b4d0-af01d7590671 tempest-ProjectMemberTests-780059112 None] Lock "cinder-289d3525-96f9-49e1-a2a8-1a7e6eb484d4-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Flow 'volume_create_manager' (3c2bbce0-8b57-43a1-b925-ab0490c836b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b6ab18-044f-40f6-bf99-f8d63903137f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b6ab18-044f-40f6-bf99-f8d63903137f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335149752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bce804-b597-4b4a-b4e0-21400656e5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7269ea69f6274b859eafff403b4e1e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:27:08Z,use_quota=True,user_id='e1f9f755c3044610854c762ed683a86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853cd81a-ddbc-4144-97fa-ab877b4c7391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853cd81a-ddbc-4144-97fa-ab877b4c7391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cc52ce-3baa-42c9-b8eb-ea69300ec38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cc52ce-3baa-42c9-b8eb-ea69300ec38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17bce804-b597-4b4a-b4e0-21400656e5ba', 'volume_name': 'volume-17bce804-b597-4b4a-b4e0-21400656e5ba', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b35b79e-5396-4618-8268-32718fa47539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b35b79e-5396-4618-8268-32718fa47539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214112c2-dd60-4ab3-aba5-723679354aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:08 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Volume 17bce804-b597-4b4a-b4e0-21400656e5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17bce804-b597-4b4a-b4e0-21400656e5ba', 'volume_size': 1} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335149752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bce804-b597-4b4a-b4e0-21400656e5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7269ea69f6274b859eafff403b4e1e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:27:08Z,use_quota=True,user_id='e1f9f755c3044610854c762ed683a86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Creating volume 17bce804-b597-4b4a-b4e0-21400656e5ba {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:27:08 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:08 devstack sudo[109786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba 1073741824 Sep 25 17:27:08 devstack sudo[109786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:08 devstack sudo[109786]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba 1073741824" returned: 0 in 0.444s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:08 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:08 devstack sudo[109791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba Sep 25 17:27:08 devstack sudo[109791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:09 devstack sudo[109791]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba" returned: 0 in 0.233s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214112c2-dd60-4ab3-aba5-723679354aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17bce804-b597-4b4a-b4e0-21400656e5ba', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852447a0-61a7-4554-8f71-071d7f3e439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:09 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Volume volume-17bce804-b597-4b4a-b4e0-21400656e5ba (17bce804-b597-4b4a-b4e0-21400656e5ba): created successfully Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852447a0-61a7-4554-8f71-071d7f3e439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Flow 'volume_create_manager' (3c2bbce0-8b57-43a1-b925-ab0490c836b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:27:09 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-bd4e34e5-acac-4c9a-9d89-87da6f9a4aab tempest-ProjectReaderTests-408332732 None] Created volume successfully. Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Acquiring lock "cinder-17bce804-b597-4b4a-b4e0-21400656e5ba-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Lock "cinder-17bce804-b597-4b4a-b4e0-21400656e5ba-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Acquiring lock "cinder-quobyte-17bce804-b597-4b4a-b4e0-21400656e5ba" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Lock "cinder-quobyte-17bce804-b597-4b4a-b4e0-21400656e5ba" acquired by "delete_volume" :: waited 0.019s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f4cc19-896e-436d-bf49-2ddd112e06ae]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:27:09 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:09 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba Sep 25 17:27:09 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:10 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba" returned: 0 in 0.413s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:10 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba Sep 25 17:27:10 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:10 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-17bce804-b597-4b4a-b4e0-21400656e5ba" returned: 0 in 0.265s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Lock "cinder-quobyte-17bce804-b597-4b4a-b4e0-21400656e5ba" released by "delete_volume" :: held 0.724s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Created reservations ['b1378259-98c8-49ff-b95e-b92c95cbb69a', 'b4e410bf-41b6-40b3-b01b-3f5fd3b7cb44', 'bfde0114-4953-471f-8219-8468430123ce', 'd8aabc13-020c-42dd-8868-0f10f0c5ccf5'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:10 devstack sudo[109804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:27:10 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:10 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.275s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:27:10 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Deleted volume successfully. Sep 25 17:27:10 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-6e417bcb-1dc1-4830-9cc2-ef5b88c79453 tempest-ProjectReaderTests-408332732 None] Lock "cinder-17bce804-b597-4b4a-b4e0-21400656e5ba-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87232) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Flow 'volume_create_manager' (8ebdc6fa-6e4f-4a41-b37d-fd2e78c97bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e345d769-f335-47f6-a23f-8c814e5d52a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e345d769-f335-47f6-a23f-8c814e5d52a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478875447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b60fd4f-0087-4b76-a0fe-e990f89ffb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7269ea69f6274b859eafff403b4e1e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:27:11Z,use_quota=True,user_id='e1f9f755c3044610854c762ed683a86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b2b575-4fc9-46b5-bee5-379ff3153d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b2b575-4fc9-46b5-bee5-379ff3153d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d18570-fde0-462f-a6ec-e69084fbce19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d18570-fde0-462f-a6ec-e69084fbce19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b60fd4f-0087-4b76-a0fe-e990f89ffb26', 'volume_name': 'volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1832c2f9-dcb1-4aa4-b453-1850a69e4586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1832c2f9-dcb1-4aa4-b453-1850a69e4586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6929c49-9647-4d1a-ae15-dea33e910472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:11 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Volume 4b60fd4f-0087-4b76-a0fe-e990f89ffb26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26', 'volume_size': 1} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T15:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478875447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b60fd4f-0087-4b76-a0fe-e990f89ffb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7269ea69f6274b859eafff403b4e1e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T15:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T15:27:11Z,use_quota=True,user_id='e1f9f755c3044610854c762ed683a86c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21a923f7-ae6f-4180-84f3-9255f2d1e2a5),volume_type_id=21a923f7-ae6f-4180-84f3-9255f2d1e2a5)}" {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.remotefs [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Creating volume 4b60fd4f-0087-4b76-a0fe-e990f89ffb26 {{(pid=87232) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Selected osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b as target Quobyte volume. {{(pid=87232) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 17:27:11 devstack cinder-volume[87232]: INFO cinder.volume.drivers.remotefs [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] casted to osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 1073741824 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:11 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 1073741824 Sep 25 17:27:11 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:11 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 1073741824" returned: 0 in 0.464s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:11 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:11 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 Sep 25 17:27:11 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:12 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26" returned: 0 in 0.269s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:12 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'} {{(pid=87232) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 17:27:12 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:27:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6929c49-9647-4d1a-ae15-dea33e910472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26', 'volume_size': 1}' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41d0817-73f2-4b50-b990-5e8e5918ed98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 17:27:12 devstack cinder-volume[87232]: INFO cinder.volume.flows.manager.create_volume [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Volume volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 (4b60fd4f-0087-4b76-a0fe-e990f89ffb26): created successfully Sep 25 17:27:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41d0817-73f2-4b50-b990-5e8e5918ed98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87232) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 17:27:12 devstack cinder-volume[87232]: DEBUG cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Flow 'volume_create_manager' (8ebdc6fa-6e4f-4a41-b37d-fd2e78c97bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87232) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 17:27:12 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0ddf2414-8b1e-4588-8abb-9693e5022d64 tempest-ProjectReaderTests-408332732 None] Created volume successfully. Sep 25 17:27:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Acquiring lock "cinder-4b60fd4f-0087-4b76-a0fe-e990f89ffb26-delete_volume" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:27:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Lock "cinder-4b60fd4f-0087-4b76-a0fe-e990f89ffb26-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:27:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Acquiring lock "cinder-quobyte-4b60fd4f-0087-4b76-a0fe-e990f89ffb26" by "delete_volume" {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 17:27:13 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Lock "cinder-quobyte-4b60fd4f-0087-4b76-a0fe-e990f89ffb26" acquired by "delete_volume" :: waited 0.015s {{(pid=87232) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 17:27:13 devstack cinder-volume[87232]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b810c6-2933-4239-81ab-ad64ab9156cf]: (4, 'qcow2') {{(pid=88691) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 17:27:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:13 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 Sep 25 17:27:13 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:13 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26" returned: 0 in 0.359s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:13 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:13 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26 Sep 25 17:27:13 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:14 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b/volume-4b60fd4f-0087-4b76-a0fe-e990f89ffb26" returned: 0 in 0.247s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Lock "cinder-quobyte-4b60fd4f-0087-4b76-a0fe-e990f89ffb26" released by "delete_volume" :: held 0.651s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG cinder.quota [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Created reservations ['85593bd8-e00f-4a02-a400-5888bedbce7e', '2f60e30e-c137-4170-b354-6ac781ae5986', '21d18a54-47dc-495d-a8a5-494a01046dda', '3e1b96e9-c6b3-4979-ae27-f951ce927dff'] {{(pid=87232) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b': None} {{(pid=87232) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG cinder.volume.drivers.quobyte [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-75ab3cea-fb78-47d4-9fd5-1ce21642556b'] {{(pid=87232) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.lockutils [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87232) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 17:27:14 devstack sudo[109824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b Sep 25 17:27:14 devstack sudo[109824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 17:27:14 devstack sudo[109824]: pam_unix(sudo:session): session closed for user root Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG oslo_concurrency.processutils [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc0fa456317d32f554272bdbf924423b" returned: 0 in 0.246s {{(pid=87232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG cinder.manager [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Notifying Schedulers of capabilities ... {{(pid=87232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 17:27:14 devstack cinder-volume[87232]: INFO cinder.volume.manager [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Deleted volume successfully. Sep 25 17:27:14 devstack cinder-volume[87232]: DEBUG cinder.coordination [None req-0235c3c7-c9c8-421b-a4b9-792ec670a60f tempest-ProjectReaderTests-408332732 None] Lock "cinder-4b60fd4f-0087-4b76-a0fe-e990f89ffb26-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87232) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 17:27:24 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=108,cinder:INSERT=31,cinder:UPDATE=142,cinder:DELETE=7 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 17:27:24 devstack cinder-volume[87232]: DEBUG dbcounter [-] [87232] Writing DB stats cinder:SELECT=100,cinder:INSERT=42,cinder:UPDATE=131,cinder:DELETE=15 {{(pid=87232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}